00000100:00100000:0.0F:1789176441.906382:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975845504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176441.906457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176441.906525:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975845504 00000100:00100000:0.0:1789176441.906532:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975845504 00000100:00100000:0.0:1789176441.906589:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176441.906599:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975845504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176441.906630:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789176441.906676:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975845504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176441.906683:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176441.906738:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975845504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0F:1789176441.912604:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975845632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176441.912682:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1789176441.913239:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975845632 00000100:00100000:3.0:1789176441.913254:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975845632 00000100:00100000:3.0:1789176441.913358:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789176441.913369:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975845632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176441.913398:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789176441.913453:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975845632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176441.913460:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789176441.913819:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975845632:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0F:1789176441.915782:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176442.418061:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176442.418087:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975845760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176442.418153:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176442.418208:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975845760 00000100:00100000:0.0:1789176442.418216:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975845760 00000100:00100000:0.0:1789176442.418263:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176442.418272:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975845760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176442.418305:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176442.418349:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975845760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176442.418356:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176442.418404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975845760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176442.476510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476559:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476593:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476616:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476662:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476679:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476700:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476755:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176442.476792:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844992 00000100:00100000:1.0:1789176442.476805:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844992 00000100:00100000:1.0:1789176442.476930:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845504 00000100:00100000:1.0:1789176442.476934:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845504 00000100:00100000:1.0:1789176442.476950:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844864 00000100:00100000:1.0:1789176442.476953:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844864 00000100:00100000:1.0:1789176442.476968:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845376 00000100:00100000:1.0:1789176442.476970:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845376 00000100:00100000:1.0:1789176442.476989:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1789176442.476999:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955844992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477107:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955844992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 108us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477116:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1789176442.477137:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1789176442.477144:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955845504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477169:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955845504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477176:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1789176442.477187:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:1.0:1789176442.477208:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+22:2389:x1876086955844864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477237:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+22:2389:x1876086955844864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477244:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:1.0:1789176442.477256:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:1.0:1789176442.477262:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2389:x1876086955845376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477292:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2389:x1876086955845376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477298:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:1.0:1789176442.477318:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845248 00000100:00100000:1.0:1789176442.477321:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845248 00000100:00100000:1.0:1789176442.477346:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845760 00000100:00100000:1.0:1789176442.477349:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845760 00000100:00100000:1.0:1789176442.477360:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845120 00000100:00100000:1.0:1789176442.477362:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845120 00000100:00100000:1.0:1789176442.477372:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845632 00000100:00100000:1.0:1789176442.477374:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845632 00000100:00100000:1.0:1789176442.477387:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1789176442.477393:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955845248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477419:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955845248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477427:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1789176442.477438:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176442.477444:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955845760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477472:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955845760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477484:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176442.477497:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1789176442.477504:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955845120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477530:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955845120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477537:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1789176442.477548:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1789176442.477554:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955845632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176442.477573:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955845632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.477579:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00080000:1.0:1789176442.477608:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176442.477612:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176442.477614:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176442.477616:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176442.478237:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844736 00000100:00100000:3.0:1789176442.478246:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844736 00000100:00100000:3.0:1789176442.478299:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:3.0:1789176442.478307:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:2389:x1876086955844736:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176442.478366:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:2389:x1876086955844736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 60us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176442.478373:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00010000:00010000:0.0:1789176442.675549:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176442.930132:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176442.930155:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975845888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176442.930222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.930255:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975846400:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.930279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176442.930324:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975846528:0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.930365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.930416:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975846912:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.930439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176442.930530:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975845888 00000100:00100000:3.0:1789176442.930537:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975845888 00000100:00100000:0.0:1789176442.930601:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975847040:0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.930625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176442.930641:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975847552:0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.930658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176442.930684:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975846272:0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.930706:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176442.930742:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975846784:0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.930767:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846272 00000100:00100000:0.0:1789176442.930770:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846272 00000100:00100000:0.0:1789176442.930807:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789176442.930816:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975846272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.930883:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975846272:12345-0@lo:400:kworker.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176442.930890:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789176442.930933:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846528 00000100:00100000:0.0:1789176442.930937:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846528 00000100:00100000:0.0:1789176442.930974:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847040 00000100:00100000:0.0:1789176442.930977:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847040 00000100:00100000:0.0:1789176442.930989:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847552 00000100:00100000:0.0:1789176442.930990:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847552 00000100:00100000:2.0:1789176442.935698:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975847424:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.938409:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.938608:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847424 00000100:00100000:2.0:1789176442.938617:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847424 00000100:00100000:1.0:1789176442.938740:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789176442.938754:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975846528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.938847:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975846528:12345-0@lo:400:kworker.0 Request processed in 98us (8490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.938855:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789176442.938888:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789176442.938895:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975847040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.938923:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975847040:12345-0@lo:400:kworker.0 Request processed in 29us (8298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.938944:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789176442.938969:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846400 00000100:00100000:1.0:1789176442.938974:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846400 00000100:00100000:0.0:1789176442.945853:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846912 00000100:00100000:0.0:1789176442.945867:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846912 00000100:00100000:0.0:1789176442.945909:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176442.945920:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975846400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.945970:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789176442.945979:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975846912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.946034:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975846912:12345-0@lo:400:kworker.0 Request processed in 56us (15593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.946041:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789176442.946126:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176442.946132:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176442.946135:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176442.946138:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176442.946146:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789176442.946155:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975847424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.946189:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975846528:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946197:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975847424:12345-0@lo:400:kworker.0 Request processed in 42us (7794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176442.946206:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789176442.946208:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975847040:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946248:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975846912:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946262:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975847424:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946272:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975846400:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946340:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975846144:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946378:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.946410:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975846656:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.946473:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975847168:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.946500:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176442.946515:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846144 00000100:00100000:1.0:1789176442.946520:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846144 00000100:00100000:1.0:1789176442.946551:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789176442.946558:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975846144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.946590:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975846144:12345-0@lo:400:kworker.0 Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.946597:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789176442.946657:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975846400:12345-0@lo:400:kworker.0 Request processed in 739us (16376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176442.946670:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176442.946701:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846656 00000100:00100000:0.0:1789176442.946705:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846656 00000100:00100000:0.0:1789176442.946747:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789176442.946756:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975846656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176442.946790:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975846656:12345-0@lo:400:kworker.0 Request processed in 36us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176442.946798:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789176442.947525:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975847680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176442.947558:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.947594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975846144:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.947606:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975846656:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.947630:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847680 00000100:00100000:2.0:1789176442.947634:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847680 00000100:00100000:2.0:1789176442.947657:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176442.947664:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975847680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176442.947686:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789176442.947732:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975847680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176442.947738:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176442.947771:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975847680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176442.947789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.947813:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975847296:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.947854:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.947967:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975846016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176442.947990:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176442.948019:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975846272:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.948037:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846016 00000100:00100000:2.0:1789176442.948040:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846016 00000100:00100000:2.0:1789176442.948057:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789176442.948079:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975846016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176442.948107:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789176442.948138:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975846016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176442.948145:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789176442.948171:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975846016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176442.948501:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847168 00000100:00100000:1.0:1789176442.948506:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847168 00000100:00100000:1.0:1789176442.948543:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847296 00000100:00100000:1.0:1789176442.948545:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847296 00000100:00100000:1.0:1789176442.948561:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789176442.948567:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975847168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.948612:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975847168:12345-0@lo:400:kworker.0 Request processed in 45us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.948618:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789176442.948631:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789176442.948637:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975847296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.948669:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975847296:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.948675:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789176442.948693:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975846784 00000100:00100000:1.0:1789176442.948696:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975846784 00000100:00100000:1.0:1789176442.948744:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176442.948751:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975846784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.948780:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975846784:12345-0@lo:400:kworker.0 Request processed in 30us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.948786:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176442.948813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975847168:0@lo:400:kworker.0 00000100:00080000:1.0:1789176442.948850:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176442.948855:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176442.948900:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789176442.948906:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975847552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.948941:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975847552:12345-0@lo:400:kworker.0 Request processed in 36us (18282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176442.948947:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1789176442.948973:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7444700 x1876086975847552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176442.948996:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975847552:0@lo:400:kworker.0 00000100:00100000:1.0:1789176442.949044:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975846784:0@lo:400:kworker.0 00010000:00080000:1.0:1789176442.949054:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7446a00 x1876086975847296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176442.949062:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975847296:0@lo:400:kworker.0 00000100:00100000:2.0:1789176442.953952:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176442.953968:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975845888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176442.953994:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789176442.957595:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975845888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3622us (27363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176442.957609:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176442.968484:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789176442.968497:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac5bc7800, transno 8589934596 00000004:00080000:3.0:1789176442.968521:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789176442.968555:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975845888:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789176443.322994:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789176443.323004:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789176443.323030:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789176443.323037:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:2.0:1789176443.451879:0:17129:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1789176443.451898:0:17129:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0ac7deac00 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1789176443.451904:0:17129:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bd16e3f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac7dea480 00000020:00080000:2.0:1789176443.451907:0:17129:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bd16e3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bfbfd2000 00000020:00080000:0.0:1789176443.451981:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1789176443.452048:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789176443.452115:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176443.452138:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176443.452146:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176443.452152:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43ba00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176443.452157:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176443.452165:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176443.452184:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:3.0:1789176443.452188:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176443.452192:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176443.452198:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176443.698086:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176444.722912:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176444.851197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176444.851348:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955845888 00000100:00100000:2.0:1789176444.851357:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955845888 00000100:00080000:1.0:1789176444.851463:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176444.851908:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1789176444.851921:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+13:15596:x1876086955845888:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789176444.852025:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+13:15596:x1876086955845888:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 107us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176444.852034:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1789176444.859563:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176444.859635:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846016 00000100:00100000:3.0:1789176444.859645:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846016 00000100:00100000:3.0:1789176444.859753:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1789176444.859766:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:15596:x1876086955846016:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789176444.859886:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:15596:x1876086955846016:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176444.859894:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1789176444.864081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176444.864115:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846272 00000100:00100000:3.0:1789176444.864124:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846272 00000100:00100000:3.0:1789176444.864173:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1789176444.864183:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+13:15596:x1876086955846272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789176444.864414:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+14:15596:x1876086955846272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 232us (342us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789176444.864423:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00080000:0.0:1789176444.866850:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789176445.746014:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176446.770046:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176447.026280:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975847808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176447.026357:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176447.026732:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847808 00000100:00100000:2.0:1789176447.026740:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847808 00000100:00100000:2.0:1789176447.026827:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789176447.026876:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975847808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176447.026904:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00080000:0.0:1789176447.027920:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176447.027963:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975847936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176447.028019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176447.028070:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975847936 00000100:00100000:0.0:1789176447.028076:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975847936 00000100:00100000:0.0:1789176447.028128:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789176447.028135:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975847936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176447.028162:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789176447.028202:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975847936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176447.028209:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789176447.028256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975847936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176447.028871:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975847808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1996us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176447.028880:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176447.032397:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975847808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176447.538389:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176447.538414:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975848064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176447.538482:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176447.538721:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848064 00000100:00100000:0.0:1789176447.538729:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848064 00000100:00100000:0.0:1789176447.538790:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789176447.538806:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975848064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176447.538855:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176447.538909:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975848064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176447.538915:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789176447.539107:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975848064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176447.595424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176447.595461:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176447.595490:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176447.595524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176447.595556:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846784 00000100:00100000:1.0:1789176447.595565:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846784 00000100:00100000:1.0:1789176447.595623:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:1.0:1789176447.595633:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2390:x1876086955846784:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176447.595708:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2390:x1876086955846784:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176447.595715:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00080000:1.0:1789176447.595744:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176447.595818:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846656 00000100:00100000:2.0:1789176447.595822:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846656 00000100:00100000:2.0:1789176447.595889:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846528 00000100:00100000:2.0:1789176447.595893:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846528 00000100:00100000:2.0:1789176447.595915:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1789176447.595922:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2390:x1876086955846656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176447.595953:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2390:x1876086955846656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176447.595959:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1789176447.595972:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1789176447.595979:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+14:2390:x1876086955846528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176447.596006:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+14:2390:x1876086955846528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176447.596011:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00080000:1.0:1789176447.596900:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176447.596905:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176447.597389:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846400 00000100:00100000:0.0:1789176447.597399:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846400 00000100:00100000:0.0:1789176447.597452:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:0.0:1789176447.597461:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:2390:x1876086955846400:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176447.597529:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:2390:x1876086955846400:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176447.597536:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1789176447.602745:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176447.603532:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955846912 00000100:00100000:0.0:1789176447.603544:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955846912 00000100:00100000:0.0:1789176447.603619:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1789176447.603629:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2388:x1876086955846912:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:0.0:1789176447.603656:0:19551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555df8 00000100:00080000:0.0:1789176447.603671:0:19551:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7609800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176447.603728:0:19551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1789176447.603856:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176447.604168:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+2:2388:x1876086955846912:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 540us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176447.604176:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00080000:1.0:1789176447.607640:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176447.617551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176447.617582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176447.617634:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176447.617667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176447.617716:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847296 00000100:00100000:2.0:1789176447.617725:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847296 00000100:00100000:2.0:1789176447.617785:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847424 00000100:00100000:2.0:1789176447.617789:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847424 00000100:00100000:3.0:1789176447.617867:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847040 00000100:00100000:3.0:1789176447.617871:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847040 00000100:00100000:3.0:1789176447.617916:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847168 00000100:00100000:3.0:1789176447.617919:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847168 00000100:00100000:3.0:1789176447.617943:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1789176447.617953:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2389:x1876086955847040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176447.618025:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2389:x1876086955847040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176447.618032:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1789176447.618055:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1789176447.618062:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955847168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176447.618086:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955847168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176447.618092:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00080000:3.0:1789176447.618189:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176447.618193:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176447.618196:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176447.618199:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176447.619728:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1789176447.619747:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2388:x1876086955847296:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1789176447.619773:0:18654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555e30 00000100:00080000:2.0:1789176447.619795:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9f0bef421800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789176447.619871:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789176447.620019:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+2:2388:x1876086955847296:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 281us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176447.620026:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1789176447.620040:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1789176447.620047:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2388:x1876086955847424:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1789176447.620059:0:18654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555e37 00000100:00080000:2.0:1789176447.620064:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9f0bef424000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789176447.620083:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789176447.620137:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+2:2388:x1876086955847424:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 90us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176447.620143:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00010000:00010000:3.0:1789176447.620584:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176447.620703:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176447.794080:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176448.050203:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975848448:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050271:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176448.050312:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975848960:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050335:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176448.050351:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975849472:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176448.050394:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789176448.050400:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975848320:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176448.050449:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975848832:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176448.050484:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975849344:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176448.050530:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848320 00000100:00100000:0.0:1789176448.050537:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848320 00000100:00100000:0.0:1789176448.050576:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848832 00000100:00100000:0.0:1789176448.050579:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848832 00000100:00100000:0.0:1789176448.050594:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789176448.050602:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975848320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050652:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975848320:12345-0@lo:400:kworker.0 Request processed in 51us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176448.050658:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789176448.050673:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789176448.050690:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975848832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050718:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975848832:12345-0@lo:400:kworker.0 Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176448.050724:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789176448.050774:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975848320:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.050794:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975848832:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.050898:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849472 00000100:00100000:3.0:1789176448.050903:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849472 00000100:00100000:3.0:1789176448.050950:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849344 00000100:00100000:3.0:1789176448.050953:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849344 00000100:00100000:3.0:1789176448.050974:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789176448.050982:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975849472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051019:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975849472:12345-0@lo:400:kworker.0 Request processed in 40us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051025:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789176448.051036:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789176448.051042:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975849344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051067:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975849344:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051072:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789176448.051091:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975848192:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051125:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051157:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975848704:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051179:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051195:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975849216:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051212:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051221:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975849728:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051237:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051250:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789176448.051256:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975848576:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051275:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051290:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975849088:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051310:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051323:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975849600:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051341:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.051360:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848704 00000100:00100000:3.0:1789176448.051363:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848704 00000100:00100000:3.0:1789176448.051378:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849216 00000100:00100000:3.0:1789176448.051381:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849216 00000100:00100000:3.0:1789176448.051390:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849728 00000100:00100000:3.0:1789176448.051392:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849728 00000100:00100000:3.0:1789176448.051403:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849600 00000100:00100000:3.0:1789176448.051405:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849600 00000100:00100000:3.0:1789176448.051415:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789176448.051420:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975848704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051451:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975848704:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051456:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789176448.051467:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789176448.051479:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975849216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051508:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975849216:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051514:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789176448.051523:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789176448.051529:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975849728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051553:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975849728:12345-0@lo:400:kworker.0 Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051558:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789176448.051568:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176448.051573:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975849600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051597:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975849600:12345-0@lo:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051602:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176448.051637:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975849600:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051646:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975848704:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051654:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975849216:0@lo:400:kworker.0 00010000:00080000:3.0:1789176448.051664:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd024700 x1876086975849728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176448.051672:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975849728:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051710:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848448 00000100:00100000:3.0:1789176448.051713:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848448 00000100:00100000:3.0:1789176448.051738:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848960 00000100:00100000:3.0:1789176448.051740:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848960 00000100:00100000:3.0:1789176448.051759:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848576 00000100:00100000:3.0:1789176448.051762:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848576 00000100:00100000:3.0:1789176448.051772:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849088 00000100:00100000:3.0:1789176448.051774:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849088 00000100:00100000:3.0:1789176448.051786:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176448.051791:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975848448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051820:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975848448:12345-0@lo:400:kworker.0 Request processed in 30us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051826:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176448.051868:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176448.051875:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975848960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051901:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975848960:12345-0@lo:400:kworker.0 Request processed in 28us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051906:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176448.051916:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176448.051922:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975848576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051951:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975848576:12345-0@lo:400:kworker.0 Request processed in 29us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.051957:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176448.051967:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176448.051973:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975849088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.051995:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975849088:12345-0@lo:400:kworker.0 Request processed in 23us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.052000:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176448.052023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975848576:0@lo:400:kworker.0 00000100:00100000:3.0:1789176448.052031:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975849088:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.052219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975849344:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.052230:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975848448:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.052240:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975848960:0@lo:400:kworker.0 00010000:00080000:0.0:1789176448.052250:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7446300 x1876086975849472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176448.052260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975849472:0@lo:400:kworker.0 00000100:00080000:0.0:1789176448.052279:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789176448.052283:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176448.052285:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176448.052287:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176448.052923:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975848192 00000100:00100000:2.0:1789176448.052929:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975848192 00000100:00100000:2.0:1789176448.052968:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789176448.052975:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3645:x1876086975848192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176448.053029:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3645:x1876086975848192:12345-0@lo:400:kworker.0 Request processed in 55us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176448.053036:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789176448.053078:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975849856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176448.053116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176448.053158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975848192:0@lo:400:kworker.0 00000100:00100000:0.0:1789176448.055440:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849856 00000100:00100000:0.0:1789176448.055450:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849856 00000100:00100000:0.0:1789176448.055512:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176448.055522:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975849856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176448.055542:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789176448.055609:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975849856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176448.055615:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176448.055641:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975849984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176448.055695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176448.055884:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975849984 00000100:00100000:1.0:1789176448.055900:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975849984 00000100:00100000:1.0:1789176448.055922:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789176448.055927:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975849984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176448.055944:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789176448.056044:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975849856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176448.060075:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975850112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176448.060151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176448.060252:0:18659:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789176448.060262:0:18659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789176448.060712:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850112 00000100:00100000:0.0:1789176448.060722:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850112 00000100:00100000:3.0:1789176448.060987:0:20489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176448.060997:0:20489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975850112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176448.061021:0:20489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176448.061085:0:20489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975850112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176448.061092:0:20489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789176448.061179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975850112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176448.064990:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975849984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9051us (9283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176448.065005:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176448.072233:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975849984:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789176448.242554:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789176448.818042:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789176449.400185:0:20527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:27:27 (1789176447) 00000001:00080000:1.0:1789176449.595027:0:17129:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1789176449.595167:0:17129:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1789176449.595569:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1789176449.595583:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1789176449.842331:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176450.866501:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176451.890144:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176452.148107:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176452.148132:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975850240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176452.148132:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975850368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176452.153956:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176452.154109:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850368 00000100:00100000:1.0:1789176452.154117:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850368 00000100:00100000:1.0:1789176452.154169:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789176452.154178:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975850368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176452.154214:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789176452.154273:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975850368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176452.154280:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789176452.154376:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975850368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176452.160511:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176452.160906:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850240 00000100:00100000:0.0:1789176452.160916:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850240 00000100:00100000:0.0:1789176452.160992:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176452.161003:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975850240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176452.161035:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789176452.161100:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975850240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176452.161107:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789176452.161547:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975850240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789176452.162936:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176452.658518:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176452.658541:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975850496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176452.658608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176452.658772:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850496 00000100:00100000:2.0:1789176452.658780:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850496 00000100:00100000:2.0:1789176452.658822:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789176452.658850:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975850496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176452.658883:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176452.658940:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975850496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176452.658948:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789176452.659889:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975850496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176452.714324:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176452.714377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176452.714414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176452.714452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176452.714475:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176452.714521:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847936 00000100:00100000:0.0:1789176452.714532:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847936 00000100:00100000:0.0:1789176452.714594:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1789176452.714603:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955847936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176452.714686:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955847936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 84us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176452.714693:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1789176452.714743:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847552 00000100:00100000:0.0:1789176452.714747:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847552 00000100:00100000:0.0:1789176452.714771:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:0.0:1789176452.714777:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+13:2389:x1876086955847552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176452.714801:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+13:2389:x1876086955847552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176452.714807:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00080000:0.0:1789176452.714890:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176452.719575:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847680 00000100:00100000:3.0:1789176452.719589:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847680 00000100:00100000:3.0:1789176452.719688:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848192 00000100:00100000:3.0:1789176452.719692:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848192 00000100:00100000:3.0:1789176452.719720:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:3.0:1789176452.719732:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+13:2389:x1876086955847680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176452.719822:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+13:2389:x1876086955847680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 92us (5506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176452.719858:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:3.0:1789176452.719876:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:3.0:1789176452.719884:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955848192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176452.719912:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2389:x1876086955848192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (5499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176452.719918:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00080000:0.0:1789176452.720934:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176452.720940:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176452.734624:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955847808 00000100:00100000:2.0:1789176452.734631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176452.734639:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955847808 00000100:00080000:2.0:1789176452.734683:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176452.734718:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848064 00000100:00100000:0.0:1789176452.734722:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848064 00000100:00100000:2.0:1789176452.734739:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:2.0:1789176452.734765:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955847808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176452.734773:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1789176452.734784:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2389:x1876086955848064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1789176452.734886:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176452.735088:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2389:x1876086955848064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 305us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176452.735097:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1789176452.738124:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2389:x1876086955847808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3352us (23635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176452.738138:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00010000:00010000:3.0:1789176452.915714:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176453.170338:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975850624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176453.170343:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975850752:0@lo:400:kworker.0 00000100:00100000:0.0:1789176453.170417:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176453.170433:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf724a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975850880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176453.172513:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975851392:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172701:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.172752:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975851136:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.172797:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975851648:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.172846:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975852160:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172869:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.172888:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789176453.172894:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975851264:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172915:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.172933:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975851776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.172968:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975852288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.172987:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.175338:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850624 00000100:00100000:3.0:1789176453.175365:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850624 00000100:00100000:3.0:1789176453.175432:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176453.175444:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975850624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789176453.175473:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176453.175540:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975850624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.175548:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176453.175657:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851136 00000100:00100000:3.0:1789176453.175662:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851136 00000100:00100000:3.0:1789176453.175689:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851648 00000100:00100000:3.0:1789176453.175692:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851648 00000100:00100000:3.0:1789176453.175703:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851264 00000100:00100000:3.0:1789176453.175705:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851264 00000100:00100000:3.0:1789176453.175716:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851776 00000100:00100000:3.0:1789176453.175719:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851776 00000100:00100000:3.0:1789176453.175730:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176453.175799:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975851136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.175853:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975851136:12345-0@lo:400:kworker.0 Request processed in 117us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.175859:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176453.175873:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176453.175879:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975851648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.175908:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975851648:12345-0@lo:400:kworker.0 Request processed in 29us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.175913:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176453.175924:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176453.175930:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975851264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.175956:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975851264:12345-0@lo:400:kworker.0 Request processed in 26us (3039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.175969:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176453.175981:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176453.175987:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975851776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176014:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975851776:12345-0@lo:400:kworker.0 Request processed in 27us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.176020:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176453.176054:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852160 00000100:00100000:3.0:1789176453.176058:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852160 00000100:00100000:3.0:1789176453.176085:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852288 00000100:00100000:3.0:1789176453.176088:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852288 00000100:00100000:3.0:1789176453.176108:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789176453.176115:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975852160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176156:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975852160:12345-0@lo:400:kworker.0 Request processed in 41us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.176163:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789176453.176175:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789176453.176180:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975852288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176207:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975852288:12345-0@lo:400:kworker.0 Request processed in 27us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.176213:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789176453.176229:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176453.176232:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176453.176235:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176453.176237:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176453.176406:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975851264:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176419:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975851776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176440:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975852288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975851136:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176460:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975851648:0@lo:400:kworker.0 00010000:00080000:3.0:1789176453.176471:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac851a300 x1876086975852160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176453.176480:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975852160:0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.176495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975850624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176453.177105:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.177470:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850752 00000100:00100000:3.0:1789176453.177477:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850752 00000100:00100000:3.0:1789176453.177578:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789176453.177588:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3645:x1876086975850752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.177639:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3645:x1876086975850752:12345-0@lo:400:kworker.0 Request processed in 53us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.177660:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789176453.178167:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176453.178206:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975851008:0@lo:400:kworker.0 00000100:00100000:0.0:1789176453.178312:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176453.179989:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975850752:0@lo:400:kworker.0 00000100:00100000:2.0:1789176453.180056:0:20489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975850880 00000100:00100000:2.0:1789176453.180063:0:20489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975850880 00000100:00100000:2.0:1789176453.180115:0:20489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789176453.180124:0:20489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975850880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176453.180145:0:20489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789176453.180206:0:20489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975850880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.180213:0:20489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789176453.180259:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851008 00000100:00100000:2.0:1789176453.180263:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851008 00000100:00100000:2.0:1789176453.180289:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789176453.180295:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975851008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176453.180331:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975851008:12345-0@lo:400:kworker.0 Request processed in 36us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.180337:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789176453.181414:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975851008:0@lo:400:kworker.0 00000100:00100000:0.0:1789176453.181427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975851520:0@lo:400:kworker.0 00000100:00100000:0.0:1789176453.181470:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176453.181507:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975852032:0@lo:400:kworker.0 00000100:00100000:0.0:1789176453.181531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176453.182660:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851520 00000100:00100000:2.0:1789176453.182671:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851520 00000100:00100000:2.0:1789176453.182723:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789176453.182742:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975851520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176453.182804:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975851520:12345-0@lo:400:kworker.0 Request processed in 73us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.182828:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789176453.183120:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975852544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176453.183156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176453.183206:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf724a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975850880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176453.183248:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975851520:0@lo:400:kworker.0 00000100:00100000:2.0:1789176453.184906:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852544 00000100:00100000:2.0:1789176453.184920:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852544 00000100:00100000:2.0:1789176453.184983:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789176453.184993:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975852544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176453.185014:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789176453.185238:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975852544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 245us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.185246:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176453.186114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176453.186237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975852544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176453.190941:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975851904:0@lo:400:kworker.0 00000100:00100000:1.0:1789176453.191022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176453.191145:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852032 00000100:00100000:3.0:1789176453.191153:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852032 00000100:00100000:3.0:1789176453.191230:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851392 00000100:00100000:3.0:1789176453.191234:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851392 00000100:00100000:3.0:1789176453.191255:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789176453.191406:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975852032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.191466:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975852032:12345-0@lo:400:kworker.0 Request processed in 203us (9933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176453.193607:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975852416:0@lo:400:kworker.0 00000100:00100000:1.0:1789176453.193673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789176453.193743:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176453.193760:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975851904 00000100:00100000:1.0:1789176453.193767:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975851904 00000100:00100000:2.0:1789176453.194536:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789176453.194552:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975851392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176453.194633:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975851392:12345-0@lo:400:kworker.0 Request processed in 87us (8521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.194640:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789176453.194675:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852416 00000100:00100000:2.0:1789176453.194679:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852416 00000100:00100000:2.0:1789176453.194709:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789176453.194715:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975852416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176453.194744:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975852416:12345-0@lo:400:kworker.0 Request processed in 29us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.194751:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789176453.195099:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975852032:0@lo:400:kworker.0 00000100:00100000:0.0:1789176453.195145:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975851392:0@lo:400:kworker.0 00010000:00080000:0.0:1789176453.195160:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f2a00 x1876086975852416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176453.195170:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975852416:0@lo:400:kworker.0 00000100:00080000:0.0:1789176453.195192:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176453.199079:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789176453.199497:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789176453.199526:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975851904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176453.199681:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975851904:12345-0@lo:400:kworker.0 Request processed in 160us (8658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176453.199688:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789176453.202016:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975851904:0@lo:400:kworker.0 00000040:00080000:0.0:1789176453.557739:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789176453.557748:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176453.557792:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789176453.557803:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789176453.638234:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176453.638349:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848448 00000100:00100000:1.0:1789176453.638359:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848448 00000100:00100000:1.0:1789176453.638418:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176453.638429:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+13:16357:x1876086955848448:12345-192.168.203.30@tcp:35:umount.0 00000001:00080000:1.0:1789176453.638689:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1789176453.638776:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1789176453.638943:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+16:16357:x1876086955848448:12345-192.168.203.30@tcp:35:umount.0 Request processed in 514us (725us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1789176453.638951:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000020:00080000:1.0:1789176453.638956:0:17152:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789176453.642970:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176453.643012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176453.643050:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176453.643196:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848576 00000100:00100000:2.0:1789176453.643206:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848576 00000100:00100000:2.0:1789176453.643265:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848832 00000100:00100000:2.0:1789176453.643269:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848832 00000100:00100000:2.0:1789176453.643282:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848704 00000100:00100000:2.0:1789176453.643285:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848704 00000100:00100000:2.0:1789176453.643316:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1789176453.643325:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+15:2390:x1876086955848576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176453.643339:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176453.643358:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff4b expref: 15 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176453.643376:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176453.643433:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+14:2390:x1876086955848576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 107us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.643440:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1789176453.643456:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1789176453.643462:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+13:2390:x1876086955848832:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176453.643470:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176453.643479:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c0555e92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0032 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176453.643487:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176453.643502:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+12:2390:x1876086955848832:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 41us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.643508:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1789176453.643518:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176453.643523:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd422450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+11:2390:x1876086955848704:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176453.643529:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176453.643537:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0555dd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff7c expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176453.643556:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176453.643574:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd422450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+10:2390:x1876086955848704:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 51us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176453.643581:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176453.644403:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176453.644509:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955848960 00000100:00100000:1.0:1789176453.644516:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955848960 00000100:00100000:1.0:1789176453.644562:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1789176453.644571:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2388:x1876086955848960:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:1.0:1789176453.644603:0:18654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555df1 00000100:00080000:1.0:1789176453.644611:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176453.644677:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789176453.644805:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+2:2388:x1876086955848960:12345-192.168.203.30@tcp:9:umount.0 Request processed in 234us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176453.644813:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00010000:00010000:2.0:1789176453.645664:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789176453.649451:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000020:00000080:1.0:1789176453.649471:0:18651:0:(genops.c:885:class_export_put()) final put ffff9f0ac7609000/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000001:00100000:1.0:1789176453.649496:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000020:00000080:1.0:1789176453.649506:0:18651:0:(genops.c:885:class_export_put()) final put ffff9f0bef426800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000020:00000080:3.0:1789176453.649654:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7609000/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 for lustre-OST0000 00000020:00000080:3.0:1789176453.649701:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bef426800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d for lustre-OST0000 00000020:00000080:3.0:1789176453.649718:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac760e000 for lustre-OST0000 00000020:00000080:3.0:1789176453.649722:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bef421800 for lustre-OST0000 00000100:00100000:3.0:1789176453.656077:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176453.656252:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955849856 00000100:00100000:0.0:1789176453.656262:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955849856 00000100:00100000:0.0:1789176453.656321:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1789176453.656332:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+16:2388:x1876086955849856:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:0.0:1789176453.656363:0:17150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555de3 00000020:00010000:0.0:1789176453.656377:0:17150:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0ac7cc8800: total 0 00000100:00080000:0.0:1789176453.656382:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176453.656420:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1789176453.656574:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+15:2388:x1876086955849856:12345-192.168.203.30@tcp:39:umount.0 Request processed in 244us (505us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1789176453.656582:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000020:00010000:1.0:1789176453.656770:0:17138:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0ac7cc8800: total 0 00010000:00010000:1.0:1789176453.656823:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0ac7cc8800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789176453.656904:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:1.0:1789176453.656908:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789176453.656917:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e8 expref: 14 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.656935:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0be7d40b00) 00010000:00010000:1.0:1789176453.656937:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176453.656941:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555eae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0039 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.656958:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:1.0:1789176453.656961:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789176453.656964:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0078 expref: 12 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.656980:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:1.0:1789176453.656983:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789176453.656986:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.656998:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:1.0:1789176453.656999:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789176453.657003:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a2 expref: 10 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.657034:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:1.0:1789176453.657036:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176453.657041:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555f09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe004e expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.657052:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:1.0:1789176453.657055:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789176453.657058:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0556098 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00cc expref: 8 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.657073:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac7472f00) 00010000:00010000:1.0:1789176453.657075:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176453.657079:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b600/0x4b53e3d2c0555eca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0040 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176453.657093:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0ac7cc8800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1789176453.657106:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176453.657107:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176453.657109:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176453.663312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176453.663600:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955849984 00000100:00100000:0.0:1789176453.663623:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955849984 00000100:00100000:0.0:1789176453.663689:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1789176453.663699:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2388:x1876086955849984:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:0.0:1789176453.663730:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555dea 00000100:00080000:0.0:1789176453.663747:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9f0bd163e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176453.663776:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789176453.664340:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176453.664421:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+3:2388:x1876086955849984:12345-192.168.203.30@tcp:39:umount.0 Request processed in 721us (1115us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789176453.664431:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000001:00100000:3.0:1789176453.684577:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000020:00000080:3.0:1789176453.684585:0:19468:0:(genops.c:885:class_export_put()) final put ffff9f0bef427800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:3.0:1789176453.684608:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000020:00000080:3.0:1789176453.684610:0:19468:0:(genops.c:885:class_export_put()) final put ffff9f0ac760e800/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000020:00000080:1.0:1789176453.685046:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bef427800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d for lustre-OST0001 00000020:00000080:1.0:1789176453.685095:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac760e800/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 for lustre-OST0001 00000020:00000080:1.0:1789176453.685110:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bef424000 for lustre-OST0001 00000020:00000080:1.0:1789176453.685114:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7609800 for lustre-OST0001 00010000:00010000:3.0:1789176453.938001:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176454.962050:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176455.523180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176455.523410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176455.530221:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176455.535862:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955850112 00000100:00100000:1.0:1789176455.535876:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955850112 00000100:00100000:1.0:1789176455.535949:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955850240 00000100:00100000:1.0:1789176455.535966:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955850240 00000100:00100000:1.0:1789176455.535996:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1789176455.536004:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+11:2392:x1876086955850112:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176455.536020:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176455.536039:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0555e0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffbb expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176455.536057:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176455.536739:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+10:2392:x1876086955850112:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 732us (13566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176455.536748:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1789176455.536769:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1789176455.536777:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+9:2392:x1876086955850240:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176455.536786:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176455.536798:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c0555e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffec expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176455.536807:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176455.547777:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+8:2392:x1876086955850240:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 10987us (24354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176455.547792:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176455.548508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176455.548621:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955850624 00000100:00100000:2.0:1789176455.548639:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955850624 00000100:00100000:2.0:1789176455.548695:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1789176455.548704:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2388:x1876086955850624:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:2.0:1789176455.548752:0:17150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555e22 00000020:00010000:2.0:1789176455.548760:0:17150:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0ac7173800: total 0 00000100:00080000:2.0:1789176455.548764:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7174800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789176455.548786:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1789176455.548954:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2388:x1876086955850624:12345-192.168.203.30@tcp:39:umount.0 Request processed in 238us (438us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789176455.548962:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00080000:2.0:1789176455.549034:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1789176455.549110:0:17138:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0ac7173800: total 0 00010000:00010000:1.0:1789176455.549154:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0ac7173800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789176455.549199:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:1.0:1789176455.549203:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176455.549211:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555f17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0055 expref: 4 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176455.549250:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0ac7173800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789176455.549263:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176455.549265:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176455.549267:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176455.549281:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955850368 00000100:00100000:1.0:1789176455.549285:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955850368 00000100:00100000:1.0:1789176455.549325:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1789176455.549333:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1160d84f-88cf-485a-bb71-d807dd20028e+8:2389:x1876086955850368:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176455.549342:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176455.549353:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0555e8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe002b expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176455.549365:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176455.549388:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1160d84f-88cf-485a-bb71-d807dd20028e+7:2389:x1876086955850368:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 56us (19176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176455.549394:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1789176455.564417:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176455.566055:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955850752 00000100:00100000:0.0:1789176455.566068:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955850752 00000100:00100000:0.0:1789176455.566164:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:0.0:1789176455.566175:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2388:x1876086955850752:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:0.0:1789176455.566215:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555e29 00000100:00080000:0.0:1789176455.566225:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7171800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176455.566254:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1789176455.566397:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+3:2388:x1876086955850752:12345-192.168.203.30@tcp:39:umount.0 Request processed in 224us (1989us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789176455.566405:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00010000:00010000:1.0:1789176455.566680:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176455.566729:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176455.608694:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176455.609074:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851008 00000100:00100000:2.0:1789176455.609097:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851008 00000100:00100000:3.0:1789176455.609433:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:3.0:1789176455.609444:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+7:2388:x1876086955851008:12345-192.168.203.30@tcp:251:umount.0 00000020:00000080:3.0:1789176455.609487:0:17143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555dc0 00000020:00010000:3.0:1789176455.609495:0:17143:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0ac7cca000: total 0 00000100:00080000:3.0:1789176455.609500:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7ccc800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789176455.609644:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+3:2388:x1876086955851008:12345-192.168.203.30@tcp:251:umount.0 Request processed in 201us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176455.609663:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 173 00000020:00010000:1.0:1789176455.616556:0:17137:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0ac7cca000: total 0 00010000:00010000:1.0:1789176455.616565:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176455.618912:0:17137:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0ac7cca000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789176455.619176:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc49c00/0x4b53e3d2c0555dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff44 expref: 2 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176455.619263:0:17137:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0ac7cca000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789176455.619277:0:17137:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cca000/1160d84f-88cf-485a-bb71-d807dd20028e 00010000:00010000:1.0:1789176455.619306:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176455.619309:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176455.619326:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789176455.619507:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cca000/1160d84f-88cf-485a-bb71-d807dd20028e for MGS 00000020:00000080:2.0:1789176455.619557:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7ccc800 for MGS 00010000:00010000:2.0:1789176455.986131:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176457.010460:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176457.267650:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176457.267674:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975852672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176457.267741:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176457.267804:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852672 00000100:00100000:2.0:1789176457.267813:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852672 00000100:00100000:2.0:1789176457.267876:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789176457.267886:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf724a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975852672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176457.267921:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789176457.267969:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf724a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975852672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176457.267975:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789176457.268023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975852672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176457.268300:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176457.268311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975852800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176457.268426:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176457.270202:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852800 00000100:00100000:3.0:1789176457.270214:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852800 00000100:00080000:2.0:1789176457.270282:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176457.270286:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176457.270296:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975852800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176457.270331:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789176457.270415:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975852800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176457.270422:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789176457.270546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975852800:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1789176457.451675:0:20722:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789176457.464993:0:20722:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789176457.465051:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.465065:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.465073:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.465091:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.465107:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789176457.465114:0:20722:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789176457.465367:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176457.465374:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.465382:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176457.465386:0:19554:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.465394:0:19554:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176457.465401:0:19554:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176457.465407:0:19554:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789176457.465410:0:19554:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789176457.465412:0:19554:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789176457.465448:0:19554:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.465455:0:19554:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176457.465480:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.465487:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.465497:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176457.465499:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176457.465501:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176457.465516:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176457.465533:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975852928:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789176457.465598:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789176457.465603:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789176457.465609:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789176457.465632:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd16a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789176457.465705:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176457.465752:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975852928 00000100:00100000:1.0:1789176457.465759:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975852928 00000100:00100000:2.0:1789176457.465768:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975853056:0@lo:39:umount.0 00000100:00100000:2.0:1789176457.465798:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176457.465813:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176457.465822:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3643:x1876086975852928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176457.465827:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853056 00000100:00100000:2.0:1789176457.465850:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853056 00010000:00010000:1.0:1789176457.465858:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789176457.465876:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789176457.465882:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876086975853056:12345-0@lo:39:umount.0 00010000:00010000:1.0:1789176457.465883:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2c00/0x4b53e3d2c055598a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555983 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.465894:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1789176457.465901:0:17150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05559b4 00000100:00080000:2.0:1789176457.465908:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7206800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789176457.465924:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:3643:x1876086975852928:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176457.465931:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176457.465954:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1876086975853056:12345-0@lo:39:umount.0 Request processed in 72us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1789176457.465960:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176457.465961:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1789176457.465967:0:17150:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb4800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1789176457.466003:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975852928:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789176457.466039:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789176457.466089:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7206800 for lustre-MDT0000 00000100:00080000:2.0:1789176457.466456:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd16a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789176457.466516:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975853056:0@lo:39:umount.0 00000100:00080000:3.0:1789176457.468737:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176457.468744:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789176457.468750:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789176457.471399:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471419:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471426:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471432:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471469:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176457.471475:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471481:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471487:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471492:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471509:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789176457.471516:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471522:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471527:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471534:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471659:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789176457.471668:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471682:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471688:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176457.471695:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472232:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789176457.472240:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472260:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176457.472263:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472272:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176457.472280:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176457.472286:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176457.472289:0:19553:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789176457.472320:0:19553:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472327:0:19553:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176457.472355:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472359:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789176457.472362:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472365:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472371:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176457.472374:0:19554:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472377:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176457.472381:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472381:0:19554:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472388:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176457.472388:0:19554:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176457.472390:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176457.472400:0:19554:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789176457.472402:0:19554:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1789176457.472404:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176457.472404:0:19554:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:2.0:1789176457.472410:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176457.472415:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789176457.472417:0:19553:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789176457.472419:0:19553:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789176457.472419:0:19554:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472425:0:19554:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176457.472429:0:19553:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472435:0:19553:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176457.472440:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472440:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472448:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472448:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472457:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176457.472458:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176457.472459:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176457.472460:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176457.472461:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176457.472465:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176457.472468:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472473:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176457.472477:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975853312:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789176457.472487:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176457.472491:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176457.472493:0:19553:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1789176457.472504:0:19553:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472508:0:19553:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176457.472513:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.472519:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176457.472521:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176457.472523:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176457.472533:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975853568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176457.472539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176457.472577:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176457.472598:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176457.472599:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176457.472605:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975853184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176457.472605:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975853440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176457.472637:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176457.472637:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176457.472746:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789176457.472752:0:20722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176457.472761:0:20722:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1789176457.472764:0:20722:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789176457.472766:0:20722:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789176457.472798:0:20722:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789176457.472802:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789176457.472806:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176457.472811:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789176457.472816:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0ac7ccb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176457.472822:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0ac731b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176457.472826:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0bd82f1000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176457.472845:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0ac67d3000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176457.472852:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0ac7173800 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 192.168.203.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789176457.472856:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0ac7cc8800 f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 192.168.203.30@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1789176457.472870:0:20722:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9f0ac7ca0000) has exports, disconnecting them 00000020:00080000:3.0:1789176457.472875:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0ac7ccb000), last request at 1789176453 00000020:00000080:3.0:1789176457.472883:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555beb 00000100:00080000:3.0:1789176457.472898:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7ccc000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176457.472955:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac7ccb000): rc 0 00000020:00000080:3.0:1789176457.472958:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac7ccb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789176457.472968:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0ac731b800), last request at 1789176453 00000020:00000080:3.0:1789176457.472971:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b51 00000100:00080000:3.0:1789176457.472977:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0ac731a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176457.472986:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac731b800): rc 0 00000020:00000080:3.0:1789176457.472988:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac731b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789176457.472991:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0bd82f1000), last request at 1789176385 00000020:00000080:3.0:1789176457.473121:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555aa2 00000100:00080000:3.0:1789176457.473126:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0bd82f1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176457.473133:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bd82f1000): rc 0 00000020:00000080:3.0:1789176457.473135:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bd82f1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789176457.473139:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0ac67d3000), last request at 1789176385 00000020:00000080:3.0:1789176457.473142:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a47 00000100:00080000:3.0:1789176457.473144:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0ac599b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789176457.473150:0:20722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1789176457.473347:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac67d3000): rc 0 00000004:00000080:3.0:1789176457.473355:0:20722:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc1a748327ae0 00000100:00080000:3.0:1789176457.473374:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789176457.473377:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789176457.474141:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853312 00000100:00100000:2.0:1789176457.474151:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853312 00000100:00100000:2.0:1789176457.474199:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853568 00000100:00100000:2.0:1789176457.474202:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853568 00000100:00100000:2.0:1789176457.474216:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853184 00000100:00100000:2.0:1789176457.474218:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853184 00000100:00100000:2.0:1789176457.474229:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853440 00000100:00100000:2.0:1789176457.474231:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853440 00000100:00100000:2.0:1789176457.474247:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176457.474267:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+26:3644:x1876086975853312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176457.474281:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176457.474297:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0555db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555db2 expref: 26 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.474312:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176457.474364:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+25:3644:x1876086975853312:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176457.474371:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176457.474388:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176457.474393:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3642:x1876086975853568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176457.474400:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176457.474408:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135000/0x4b53e3d2c05558cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05558c6 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.474416:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176457.474441:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:3642:x1876086975853568:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176457.474447:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176457.474457:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176457.474462:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3642:x1876086975853184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176457.474469:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176457.474476:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135e00/0x4b53e3d2c05558db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05558d4 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.474484:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1789176457.474487:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789176457.474501:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3642:x1876086975853184:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (1864us total) trans 0 rc 0/0 00000100:00080000:3.0:1789176457.474506:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789176457.474512:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176457.474523:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176457.474529:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd423050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:3644:x1876086975853440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176457.474536:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176457.474544:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555e84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555e7d expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176457.474551:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176457.474571:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd423050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3644:x1876086975853440:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176457.474577:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789176457.474681:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176457.474785:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789176457.474794:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1789176457.474872:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789176457.474923:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789176457.474934:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789176457.474950:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789176457.474953:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1789176457.474962:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789176457.475034:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789176457.475044:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789176457.475081:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f0ac7ca0000) has no exports 00000100:00100000:1.0:1789176457.476685:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975853440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176457.476699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975853312:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789176457.476734:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7ccb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789176457.476881:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac731b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789176457.477087:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd82f1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789176457.477304:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7ccc000 for lustre-MDT0000 00000020:00000080:1.0:1789176457.477311:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac731a000 for lustre-MDT0000 00000020:00000080:1.0:1789176457.477314:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bd82f1800 for lustre-MDT0000 00010000:00010000:1.0:1789176457.477325:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176457.477347:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176457.477450:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176457.477544:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975853696:0@lo:39:umount.0 00000100:00100000:2.0:1789176457.477728:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975853184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176457.477739:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975853568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789176457.477899:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176457.477927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975853824:0@lo:9:umount.0 00000100:00100000:3.0:1789176457.477965:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176457.477983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975853952:0@lo:9:umount.0 00000100:00100000:3.0:1789176457.478130:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176457.478164:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853824 00000100:00100000:3.0:1789176457.478170:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853824 00000100:00100000:3.0:1789176457.478233:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853952 00000100:00100000:3.0:1789176457.478237:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853952 00000100:00100000:3.0:1789176457.478257:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176457.478265:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876086975853824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789176457.478291:0:18656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555c0e 00000100:00080000:3.0:1789176457.478299:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789176457.478336:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789176457.478462:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3641:x1876086975853824:12345-0@lo:9:umount.0 Request processed in 196us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176457.478481:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176457.478497:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176457.478504:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876086975853952:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789176457.478515:0:18656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555c15 00000100:00080000:3.0:1789176457.478521:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789176457.478542:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789176457.478758:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3641:x1876086975853952:12345-0@lo:9:umount.0 Request processed in 254us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176457.478766:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1789176457.478785:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176457.478808:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789176457.478820:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789176457.478823:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176457.478826:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975853824:0@lo:9:umount.0 00000100:00080000:3.0:1789176457.478859:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789176457.478866:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789176457.478868:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176457.478871:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975853952:0@lo:9:umount.0 00010000:00010000:1.0:1789176457.479187:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176457.479343:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975853696 00000100:00100000:2.0:1789176457.479349:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975853696 00000100:00100000:2.0:1789176457.479392:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789176457.479400:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876086975853696:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789176457.479419:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555acc 00000100:00080000:2.0:1789176457.479425:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9f0ac5999000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789176457.479447:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789176457.479547:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3641:x1876086975853696:12345-0@lo:39:umount.0 Request processed in 147us (1648us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789176457.479554:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1789176457.479661:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176457.479689:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176457.479694:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176457.479716:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789176457.479732:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975853696:0@lo:39:umount.0 00000020:00080000:3.0:1789176457.487327:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f0ac7ca0000) has no exports 00000020:00000080:3.0:1789176457.555154:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555921 00000020:00000080:3.0:1789176457.555170:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bd17c0000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789176457.555191:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789176457.555324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd17c0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789176457.555575:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176457.555586:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789176457.555591:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9f0beec83380) has no exports 00000020:00000080:0.0:1789176457.560554:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055591a 00000020:00000080:0.0:1789176457.560569:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bd17c7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789176457.560647:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd17c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789176457.560654:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176457.560666:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789176457.560669:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bd17c4000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789176457.560672:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd17c4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789176457.560697:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789176458.034010:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176458.290161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975854208:0@lo:400:kworker.0 00000100:00100000:2.0:1789176458.290161:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975854464:0@lo:400:kworker.0 00000100:00100000:0.0:1789176458.290289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975854080:0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.290403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975854336:0@lo:400:kworker.0 00000100:00100000:3.0:1789176458.294542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176458.294571:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176458.294604:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975854720:0@lo:400:kworker.0 00000100:00100000:3.0:1789176458.294663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176458.295052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176458.295087:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854464 00000100:00100000:2.0:1789176458.295094:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854464 00000100:00100000:3.0:1789176458.295240:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854208 00000100:00100000:3.0:1789176458.295246:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854208 00000100:00100000:3.0:1789176458.295281:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789176458.295288:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876086975854208:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789176458.295296:0:18392:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789176458.295324:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176458.295355:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876086975854208:12345-0@lo:400:kworker.0 Request processed in 65us (819us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176458.295363:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789176458.295386:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854080 00000100:00100000:3.0:1789176458.295391:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854080 00000100:00100000:0.0:1789176458.295404:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975854592:0@lo:400:kworker.0 00000100:00100000:3.0:1789176458.295423:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789176458.295433:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975854080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176458.295440:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176458.295464:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975855104:0@lo:400:kworker.0 00000100:00100000:3.0:1789176458.295488:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975854080:12345-0@lo:400:kworker.0 Request processed in 57us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176458.295495:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789176458.295523:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854720 00000100:00100000:3.0:1789176458.295526:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854720 00000100:00100000:3.0:1789176458.295543:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854592 00000100:00100000:3.0:1789176458.295546:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854592 00000100:00100000:3.0:1789176458.295559:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176458.295563:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876086975854720:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789176458.295568:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789176458.295899:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975854464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176458.295948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176458.295984:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975854080:0@lo:400:kworker.0 00000100:00100000:0.0:1789176458.296010:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855104 00000100:00100000:0.0:1789176458.296014:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855104 00000100:00100000:0.0:1789176458.296033:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789176458.296039:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975855104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176458.296070:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975855104:12345-0@lo:400:kworker.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176458.296075:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789176458.296087:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789176458.296091:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876086975854592:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789176458.296095:0:17149:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789176458.296112:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876086975854592:12345-0@lo:400:kworker.0 Request processed in 20us (676us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789176458.296116:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789176458.296135:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789176458.296140:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789176458.296142:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789176458.297385:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876086975854720:12345-0@lo:400:kworker.0 Request processed in 1815us (2717us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176458.297396:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789176458.297447:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789176458.297452:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789176458.297456:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789176458.297474:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176458.297478:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1789176458.297485:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac7c8c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176458.297516:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776ce00 x1876086975855360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176458.297542:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975854720:0@lo:400:kworker.0 00000100:00100000:3.0:1789176458.297564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975855232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176458.297598:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789176458.297642:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789176458.297645:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789176458.297649:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789176458.297653:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176458.297656:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:3.0:1789176458.297660:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bfd315000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176458.297674:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776fb80 x1876086975855488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176458.297684:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975854208:0@lo:400:kworker.0 00000100:00100000:3.0:1789176458.297709:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975855360:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789176458.297735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176458.297753:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975855488:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789176458.297791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176458.297821:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855488 00000100:00100000:3.0:1789176458.297847:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855488 00000100:00100000:3.0:1789176458.297874:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789176458.297879:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975855488:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789176458.297894:0:17155:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176458.299441:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176458.299490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975854848:0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.299524:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176458.299571:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854336 00000100:00100000:1.0:1789176458.299577:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854336 00000100:00100000:1.0:1789176458.299627:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176458.299635:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975854336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.299685:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975854336:12345-0@lo:400:kworker.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176458.299692:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176458.299716:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855360 00000100:00100000:1.0:1789176458.299720:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855360 00000100:00100000:1.0:1789176458.299737:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854848 00000100:00100000:1.0:1789176458.299739:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854848 00000100:00100000:1.0:1789176458.299761:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789176458.299767:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975854848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.301130:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975854848:12345-0@lo:400:kworker.0 Request processed in 1360us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176458.301153:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789176458.301239:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789176458.301245:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975855360:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789176458.301262:0:17151:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176458.301298:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975855360:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 52us (3562us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176458.301304:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789176458.301407:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975854336:0@lo:400:kworker.0 00010000:00080000:1.0:1789176458.301421:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac872fb80 x1876086975854848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176458.301432:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975854848:0@lo:400:kworker.0 00000100:00080000:1.0:1789176458.301465:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176458.301470:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176458.301473:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975855360:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789176458.301513:0:20489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855232 00000100:00100000:1.0:1789176458.301519:0:20489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855232 00000100:00100000:1.0:1789176458.301558:0:20489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176458.301565:0:20489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876086975855232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176458.301588:0:20489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176458.301638:0:20489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876086975855232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176458.301644:0:20489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176458.301677:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975855232:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789176458.301723:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176458.301734:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176458.302405:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975854464:0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.302417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975854976:0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.302459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176458.302504:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975854976 00000100:00100000:1.0:1789176458.302508:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975854976 00000100:00100000:1.0:1789176458.302533:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789176458.302537:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876086975854976:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789176458.302544:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789176458.302574:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876086975854976:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789176458.302580:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789176458.302631:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789176458.302636:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789176458.302640:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789176458.302645:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176458.302649:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 537 00000100:00080000:1.0:1789176458.302655:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac760f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176458.302679:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d59c00 x1876086975855616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789176458.302698:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975854976:0@lo:400:kworker.0 00000100:00100000:1.0:1789176458.302716:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975855616:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789176458.302739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176458.302764:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855616 00000100:00100000:1.0:1789176458.302768:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855616 00000100:00100000:1.0:1789176458.305231:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789176458.305240:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975855616:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789176458.305257:0:17149:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176458.305967:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975855616:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 723us (3223us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176458.305976:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789176458.306053:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176458.306058:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176458.306061:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975855616:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789176458.309035:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975854464:12345-0@lo:400:kworker.0 Request processed in 339us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176458.309053:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789176458.321348:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176458.321376:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1789176458.321387:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0ac749c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176458.321425:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd027800 x1876086975855744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176458.321464:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975854592:0@lo:400:kworker.0 00010000:00080000:0.0:1789176458.321497:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac872ea00 x1876086975855104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176458.321509:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975855104:0@lo:400:kworker.0 00000100:00100000:2.0:1789176458.322204:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975855744:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789176458.322272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176458.322365:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855744 00000100:00100000:1.0:1789176458.322372:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855744 00000100:00100000:1.0:1789176458.322416:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789176458.322424:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975855744:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789176458.322440:0:17151:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176458.322495:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975855744:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 71us (224us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176458.322502:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789176458.323565:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176458.323573:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789176458.323578:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975855744:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789176458.341353:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975855488:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43462us (43550us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176458.341368:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789176458.341698:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176458.341704:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176458.341709:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975855488:0@lo:38:ptlrpcd_00_02.0 00000040:00080000:1.0:1789176458.487044:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789176459.058613:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789176459.833187:0:17129:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789176459.833197:0:17129:0:(genops.c:885:class_export_put()) final put ffff9f0ac67d3000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789176459.833224:0:17129:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00080000:0.0:1789176459.833231:0:17129:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1789176459.833235:0:17129:0:(genops.c:885:class_export_put()) final put ffff9f0ac7173800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:0.0:1789176459.833240:0:17129:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000001:00080000:0.0:1789176459.833245:0:17129:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1789176459.833251:0:17129:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cc8800/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000020:00000080:2.0:1789176459.833589:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac67d3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789176459.833661:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7173800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d for lustre-MDT0000 00000020:00000080:2.0:1789176459.833686:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cc8800/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 for lustre-MDT0000 00000020:00000080:2.0:1789176459.833711:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac599b000 for lustre-MDT0000 00000020:00000080:2.0:1789176459.833716:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7174800 for lustre-MDT0000 00000020:00000080:2.0:1789176459.833720:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7cce000 for lustre-MDT0000 00000001:00100000:1.0:1789176459.837638:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789176459.837653:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789176459.837658:0:17882:0:(genops.c:885:class_export_put()) final put ffff9f0ac67d4800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789176459.837684:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00080000:1.0:1789176459.837691:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789176459.837707:0:17882:0:(genops.c:885:class_export_put()) final put ffff9f0ac7176800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:1.0:1789176459.837714:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000001:00080000:1.0:1789176459.837718:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789176459.837720:0:17882:0:(genops.c:885:class_export_put()) final put ffff9f0ac7ccb800/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000020:00000080:0.0:1789176459.837857:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac67d4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789176459.837929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7176800/889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d for lustre-MDT0001 00000020:00000080:0.0:1789176459.837955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7ccb800/f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 for lustre-MDT0001 00000020:00000080:0.0:1789176459.837973:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac5999000 for lustre-MDT0001 00000020:00000080:0.0:1789176459.837977:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7171800 for lustre-MDT0001 00000020:00000080:0.0:1789176459.837990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bd163e800 for lustre-MDT0001 00010000:00010000:1.0:1789176460.082422:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176461.109434:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176462.129991:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176462.390222:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176462.390263:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975855872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176462.390370:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176462.390520:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975855872 00000100:00100000:0.0:1789176462.390532:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975855872 00000100:00100000:0.0:1789176462.390635:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176462.390645:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975855872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176462.390686:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789176462.390739:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975855872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176462.390746:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176462.391387:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975855872:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789176462.392064:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789176463.154170:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176463.410611:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176463.410644:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975856000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176463.410747:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176463.421871:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975856128:0@lo:400:kworker.0 00000100:00100000:2.0:1789176463.421957:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789176463.422030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176463.422036:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176463.422040:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176463.422047:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1789176463.422053:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176463.422061:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bfd315000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176463.422091:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776ce00 x1876086975856256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176463.422131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176463.422153:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176463.422156:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176463.422160:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1789176463.422163:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176463.422166:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0ac749c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176463.422182:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf7320a80 x1876086975856512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176463.422192:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176463.422196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176463.422214:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176463.422219:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1789176463.422222:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176463.422227:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac7c8c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176463.422238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975856256:0@lo:38:kworker.0 00000100:00100000:3.0:1789176463.422242:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf7322680 x1876086975856640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176463.422267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176463.422271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176463.422273:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176463.422277:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1789176463.422280:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176463.422284:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac760f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176463.422289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176463.422302:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8519880 x1876086975856896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176463.422316:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975856512:0@lo:38:kworker.0 00000100:00100000:0.0:1789176463.422355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176463.422385:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975856640:0@lo:38:kworker.0 00000100:00100000:0.0:1789176463.422418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176463.422435:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975856896:0@lo:38:kworker.0 00000100:00100000:0.0:1789176463.422710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176463.422754:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856512 00000100:00100000:0.0:1789176463.422764:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856512 00000100:00100000:0.0:1789176463.422805:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856640 00000100:00100000:0.0:1789176463.422809:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856640 00000100:00100000:0.0:1789176463.422818:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856896 00000100:00100000:0.0:1789176463.422820:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856896 00000100:00100000:0.0:1789176463.422859:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176463.422868:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975856512:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789176463.422889:0:17151:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176463.427215:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856000 00000100:00100000:1.0:1789176463.427238:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856000 00000100:00100000:1.0:1789176463.427356:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789176463.427370:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975856000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176463.427378:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975857024:0@lo:400:kworker.0 00000100:00100000:2.0:1789176463.427671:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176463.427747:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857024 00000100:00100000:2.0:1789176463.427752:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857024 00000100:00100000:2.0:1789176463.427783:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789176463.427791:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975857024:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789176463.429576:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176463.430373:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856128 00000100:00100000:3.0:1789176463.430405:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856128 00000100:00100000:3.0:1789176463.430491:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789176463.430502:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176463.434904:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975856000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7522us (24141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176463.434923:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789176463.434994:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975856768:0@lo:400:kworker.0 00000100:00100000:1.0:1789176463.435045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176463.435696:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975856128:12345-0@lo:400:kworker.0 Request processed in 5192us (13734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176463.435710:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789176463.435767:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975856384:0@lo:400:kworker.0 00000100:00100000:3.0:1789176463.435801:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176463.435948:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975856128:0@lo:400:kworker.0 00000100:00100000:3.0:1789176463.435979:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975856000:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789176463.436400:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176463.436407:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176463.436422:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176463.436432:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789176463.436509:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176463.436518:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856768 00000100:00100000:3.0:1789176463.436526:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856768 00000100:00100000:3.0:1789176463.436589:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176463.436597:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789176463.436606:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975856768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176463.436673:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975856768:12345-0@lo:400:kworker.0 Request processed in 67us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176463.436680:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789176463.436691:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7320700 x1876086975856768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176463.436692:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176463.436705:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789176463.436710:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975856768:0@lo:400:kworker.0 00000100:00100000:3.0:1789176463.436712:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975856640:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789176463.436733:0:17149:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176463.436744:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856384 00000100:00100000:1.0:1789176463.436748:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856384 00000100:00100000:1.0:1789176463.436788:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176463.436796:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975856384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176463.436802:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975856640:12345-0@lo:38:kworker.0 Request processed in 88us (14381us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176463.436810:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789176463.436823:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176463.436854:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176463.436860:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975856896:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789176463.436866:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975856384:12345-0@lo:400:kworker.0 Request processed in 71us (1063us total) trans 0 rc 0/0 00010000:02000000:3.0:1789176463.436870:0:17149:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176463.436877:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176463.436901:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975856896:12345-0@lo:38:kworker.0 Request processed in 40us (14190us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176463.436908:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176463.436934:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975856256 00000100:00100000:3.0:1789176463.436938:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975856256 00000100:00100000:1.0:1789176463.436948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975856384:0@lo:400:kworker.0 00000100:00100000:3.0:1789176463.436961:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176463.436967:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975856256:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789176463.436975:0:17154:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789176463.437001:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975856256:12345-0@lo:38:kworker.0 Request processed in 34us (14714us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176463.437007:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789176463.437020:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176463.437712:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975857024:12345-0@lo:400:kworker.0 Request processed in 9916us (10035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176463.437723:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789176463.437812:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac851a680 x1876086975857024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176463.437826:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975857024:0@lo:400:kworker.0 00000100:00080000:1.0:1789176463.439337:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176463.439351:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176463.439358:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975856640:0@lo:38:kworker.0 00000100:00080000:1.0:1789176463.439374:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176463.439378:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176463.439381:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975856896:0@lo:38:kworker.0 00000100:00080000:1.0:1789176463.439395:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176463.439399:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176463.439402:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975856256:0@lo:38:kworker.0 00000100:00100000:0.0:1789176463.440624:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975856512:12345-0@lo:38:kworker.0 Request processed in 17746us (18258us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789176463.440655:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789176463.444463:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176463.444483:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176463.444490:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975856512:0@lo:38:kworker.0 00000020:01000000:0.0:1789176463.602010:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac851e840 - data ffff9f0bf81b06c0/ffff9f0bfbfd7c00 00000020:01000000:0.0:1789176463.603107:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7388900 - data ffff9f0bf8264360/ffff9f0bfba33800 00000001:00000004:0.0:1789176463.609100:0:20722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1789176463.660560:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789176463.660581:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789176463.660602:0:20722:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f0ac776e300 x1876086975853696/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789176467 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176463.660634:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789176463.668591:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789176463.668603:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1789176463.668632:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176463.668636:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789176463.671855:0:17173:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789176463.671868:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1789176463.671888:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789176463.675547:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789176463.675558:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1789176463.675586:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176463.675605:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789176463.676046:0:17175:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789176463.676052:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1789176463.676064:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789176463.677372:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05558e9 00000020:00000080:1.0:1789176463.677387:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789176463.677792:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789176463.680001:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05558fe 00000020:00000080:1.0:1789176463.680018:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789176463.680033:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789176463.680038:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176463.680048:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789176463.680052:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9f0ac7ca3380) has no exports 00000020:00000080:3.0:1789176463.680392:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789176463.680643:0:20722:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789176463.680656:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555960 00000020:00000080:1.0:1789176463.680662:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bd8ac4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789176463.680675:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789176463.680680:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176463.680687:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789176463.680690:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9f0ac75dcd40) has no exports 00000020:00000080:1.0:1789176463.680699:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555959 00000020:00000080:1.0:1789176463.680704:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bf3380800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789176463.682260:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd8ac4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789176463.682288:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf3380800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789176463.682381:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789176463.682387:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789176463.682393:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789176463.682401:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176463.682404:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176463.682646:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176463.682658:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789176463.682669:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055594b 00000020:00000080:1.0:1789176463.682679:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bf3382000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.682964:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bf3384800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789176463.682973:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bf3383800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.682976:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf3383800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789176463.682982:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176463.684788:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf3382000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789176463.684886:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789176463.684899:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176463.684912:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789176463.684918:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9f0ac75d99c0) has no exports 00000020:00000080:1.0:1789176463.684928:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555944 00000020:00000080:1.0:1789176463.685066:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a29000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789176463.685198:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a29000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789176463.686021:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789176463.686030:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789176463.686035:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789176463.686044:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176463.686046:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176463.690086:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176463.690111:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789176463.690130:0:20722:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789176463.690151:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555936 00000020:00000080:1.0:1789176463.690162:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.691329:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bc7a2c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789176463.691347:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bd1639800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.691350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd1639800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789176463.691365:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789176463.694942:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789176463.694964:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176463.694979:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789176463.694986:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9f0beec80000) has no exports 00000020:00000080:1.0:1789176463.694998:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055592f 00000020:00000080:1.0:1789176463.695010:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789176463.696506:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789176463.696942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789176463.724366:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789176463.724379:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789176463.724387:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789176463.724399:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789176463.725153:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176463.725171:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789176463.725211:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176463.725214:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789176463.725222:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789176463.725228:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789176463.725244:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789176463.725385:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555905 00000020:00000080:2.0:1789176463.725394:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d0000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789176463.725501:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bc52d1800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789176463.725511:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a2f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.725513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a2f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789176463.725523:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789176463.726867:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789176463.726986:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789176463.727005:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176463.727017:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789176463.727022:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9f0beec819c0) has no exports 00000020:00000080:3.0:1789176463.727067:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176463.727073:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789176463.727077:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d0800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789176463.727079:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789176463.727083:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789176463.727162:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055590c 00000020:00000080:3.0:1789176463.727182:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d3800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789176463.727206:0:20722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac85e2000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789176463.727210:0:20722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac85e2000 3 00000020:01000004:3.0:1789176463.727214:0:20722:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0ac85e2000 from lustre-MDT0000 00000020:00000080:3.0:1789176463.727239:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176463.727244:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789176463.727246:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d1000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789176463.727249:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789176463.727258:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789176463.727290:0:20722:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789176463.727294:0:20722:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789176463.727297:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789176463.727300:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176463.727303:0:20722:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176463.727311:0:20722:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9f0ac7e48800 a6f15dd7-fbd0-4e86-8827-d477f7554462 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176463.727317:0:20722:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9f0bfd608000) has exports, disconnecting them 00000020:00080000:3.0:1789176463.727322:0:20722:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f0ac7e48800), last request at 1789176371 00000020:00000080:3.0:1789176463.727341:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05558b1 00000020:00010000:3.0:1789176463.727345:0:20722:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0ac7e48800: total 1 00000100:00080000:3.0:1789176463.727350:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7e48000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176463.727366:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac7e48800): rc 0 00000020:00080000:3.0:1789176463.727370:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9f0bfd608000) has no exports 00000100:00100000:3.0:1789176463.727432:0:17143:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f0bc7116800:17143] 1 exiting: rc = 0 00000100:00100000:3.0:1789176463.727580:0:17141:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f0ac671f000:17141] 0 exiting: rc = 1 00000020:00000080:2.0:1789176463.730099:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1789176463.749211:0:17137:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0ac7e48800: total 0 00010000:00010000:1.0:1789176463.749303:0:17137:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0ac7e48800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789176463.749351:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a3c00/0x4b53e3d2c0555b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555b0b expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749373:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0555dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555da4 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749394:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c05559d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05559c9 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749416:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0555b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555b35 expref: 11 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749428:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0555e68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555e61 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749460:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9c800/0x4b53e3d2c0555a8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555a86 expref: 9 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749473:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c05559de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05559d7 expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749486:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c05558bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05558b8 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749497:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555ba5 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749508:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555e5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555e53 expref: 5 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749519:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494800/0x4b53e3d2c0555e76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555e6f expref: 4 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749531:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3000/0x4b53e3d2c05559ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05559e5 expref: 3 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749541:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0555bcf expref: 2 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176463.749553:0:17137:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0ac7e48800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789176463.749604:0:17137:0:(genops.c:885:class_export_put()) final put ffff9f0ac7e48800/a6f15dd7-fbd0-4e86-8827-d477f7554462 00010000:00010000:1.0:1789176463.749783:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176463.749786:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176463.749789:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176463.749907:0:17144:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f0ac671fa00:17144] 2 exiting: rc = 0 00000020:00000080:2.0:1789176463.750109:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7e48800/a6f15dd7-fbd0-4e86-8827-d477f7554462 for MGS 00000100:00100000:3.0:1789176463.750267:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750276:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750284:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750290:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750297:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750307:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750317:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750324:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750340:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750346:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750354:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750362:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750369:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750378:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750386:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750395:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750404:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750412:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750418:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750425:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750432:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750439:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750445:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750451:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750458:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750464:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750471:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750478:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750486:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750493:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750500:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750506:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750513:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750520:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750526:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750532:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750538:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750544:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750551:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750557:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750563:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750580:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750588:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750605:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750614:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750621:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750640:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750649:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750657:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750667:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750675:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750682:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750691:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750699:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750785:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750794:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750801:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750808:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750818:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750825:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750858:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750867:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750874:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176463.750881:0:20722:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789176463.751981:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7e48000 for MGS 00000020:01000000:3.0:1789176463.752059:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac851e7e0 - data ffff9f0ac5c0ebd0/ffff9f0bfbfd6800 00000020:01000000:3.0:1789176463.752282:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac1839960 - data ffff9f0bf82671b0/ffff9f0bc714f000 00000020:00000080:3.0:1789176463.753242:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555895 00000020:00000080:3.0:1789176463.753255:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac7f89800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789176463.753306:0:20722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac85e2000 from MGS, refs=2 00000020:01000004:3.0:1789176463.753311:0:20722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac85e2000 2 00000020:01000004:3.0:1789176463.753314:0:20722:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0ac85e2000 from MGS 00000020:00000080:3.0:1789176463.753345:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176463.753355:0:20722:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789176463.753359:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac7f8a800/MGS 00000020:00000080:3.0:1789176463.753362:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7f8a800/MGS for MGS 00000020:01000000:3.0:1789176463.753372:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789176463.753476:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789176463.753491:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176463.753498:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176463.753507:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f0bfd169000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176463.753514:0:20722:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9f0ac74919c0) has exports, disconnecting them 00000020:00080000:3.0:1789176463.753520:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f0bfd169000), last request at 1789176371 00000020:00000080:3.0:1789176463.753524:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555998 00000020:00080000:3.0:1789176463.753535:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd169000): rc 0 00000020:00000080:3.0:1789176463.753540:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0bfd169000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789176463.753576:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7f89800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789176463.754229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd169000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789176463.771388:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789176463.771505:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176463.771512:0:20722:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789176463.771523:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789176463.771601:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd16a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789176463.771981:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176463.771996:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789176463.772003:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac7e49800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789176463.772008:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7e49800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789176463.772016:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789176463.772132:0:20722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac85e2000 1 00000020:00000080:3.0:1789176463.772140:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555887 00000020:00000080:3.0:1789176463.772148:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac7f88000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789176463.772165:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789176463.772170:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176463.772176:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789176463.772181:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9f0ac7ca19c0) has no exports 00000020:00000080:2.0:1789176463.772209:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7f88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789176463.807631:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176463.807651:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789176463.807658:0:20722:0:(genops.c:885:class_export_put()) final put ffff9f0ac85e5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789176463.807664:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac85e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789176463.807699:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789176463.808047:0:20722:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0ac85e0800 00000020:02000400:1.0:1789176463.808281:0:20722:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1789176463.926249:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.926264:0:19468:0:(genops.c:885:class_export_put()) final put ffff9f0beb5a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789176463.926305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0beb5a0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789176463.926371:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0beb5a7000 for lustre-OST0001 00000001:00100000:2.0:1789176463.928812:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789176463.928824:0:18651:0:(genops.c:885:class_export_put()) final put ffff9f0beb5a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176463.928936:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0beb5a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789176463.929004:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0beb5a3800 for lustre-OST0000 00010000:00010000:3.0:1789176464.181931:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176465.202008:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176466.227448:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176467.254177:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176467.510309:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975857152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176467.510419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176467.510518:0:20489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857152 00000100:00100000:1.0:1789176467.510529:0:20489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857152 00000100:00100000:1.0:1789176467.510629:0:20489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176467.510641:0:20489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975857152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176467.510678:0:20489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00080000:0.0:1789176467.510820:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176467.520633:0:20489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975857152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9977us (10197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176467.520655:0:20489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789176467.521081:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975857152:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1789176467.758822:0:20924:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789176467.777323:0:20924:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789176467.777401:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.777420:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.777429:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.777436:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.777461:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789176467.777469:0:20924:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789176467.777509:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176467.777515:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789176467.777522:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789176467.777530:0:20924:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789176467.777536:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176467.777538:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789176467.777552:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789176467.778722:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.778743:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.778770:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.778778:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.778811:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789176467.778819:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.778826:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.778950:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176467.778960:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.778968:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176467.778972:0:19554:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.778982:0:19554:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176467.778990:0:19554:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176467.778997:0:19554:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176467.779000:0:19554:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789176467.779003:0:19554:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789176467.779053:0:19554:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779060:0:19554:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176467.779093:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779188:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779207:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176467.779465:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779473:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176467.779477:0:19554:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779485:0:19554:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176467.779492:0:19554:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176467.779497:0:19554:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176467.779500:0:19554:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1789176467.779517:0:19554:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779523:0:19554:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176467.779531:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779537:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.779573:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176467.779574:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176467.779577:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176467.779604:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975857280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176467.779693:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176467.779752:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176467.779758:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975857408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176467.779780:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176467.780030:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176467.780049:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857280 00000100:00100000:0.0:1789176467.780058:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857280 00000100:00100000:0.0:1789176467.780104:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857408 00000100:00100000:0.0:1789176467.780107:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857408 00010000:00010000:3.0:1789176467.782392:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782405:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782474:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176467.782490:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176467.782498:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782505:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176467.782510:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782522:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176467.782561:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176467.782568:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789176467.782571:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789176467.782573:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789176467.782630:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782637:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176467.782675:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782683:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782706:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176467.782708:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176467.782710:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176467.782723:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782732:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782738:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782745:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782768:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176467.782775:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782782:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782788:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782794:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176467.782805:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789176467.782808:0:20924:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000100:00100000:2.0:1789176467.784521:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789176467.784571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975857536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176467.784660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176467.784720:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176467.784730:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784741:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176467.784746:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784758:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176467.784766:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176467.784772:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789176467.784775:0:17137:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789176467.784792:0:17137:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789176467.784852:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784859:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176467.784882:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784889:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784905:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176467.784909:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784915:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176467.784918:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784925:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176467.784931:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176467.784936:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176467.784938:0:17137:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789176467.784940:0:17137:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789176467.784955:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784961:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176467.784986:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.784994:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176467.785009:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176467.785011:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176467.785014:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176467.785027:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975857664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176467.785061:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176467.785100:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176467.785387:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857536 00000100:00100000:0.0:1789176467.785396:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857536 00000100:00100000:0.0:1789176467.785406:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857664 00000100:00100000:0.0:1789176467.785408:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857664 00000100:00100000:0.0:1789176467.785420:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176467.785429:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876086975857280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789176467.785436:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176467 with bad export cookie 5427932470221035697 10000000:01000000:3.0:1789176467.786242:0:20924:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789176467.786303:0:20924:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789176467.786308:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789176467.786314:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176467.786322:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789176467.786329:0:20924:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0ac760c800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176467.786336:0:20924:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0ac7e4d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176467.786341:0:20924:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9f0bf720cd40) has exports, disconnecting them 00000020:00080000:3.0:1789176467.786346:0:20924:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0ac760c800), last request at 1789176463 00000020:00000080:3.0:1789176467.786356:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555c00 00000100:00080000:3.0:1789176467.786377:0:20924:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176467.786448:0:20924:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac760c800): rc 0 00000020:00000080:3.0:1789176467.786451:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac760c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789176467.786478:0:20924:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0ac7e4d000), last request at 1789176463 00000020:00000080:3.0:1789176467.786481:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b66 00000100:00080000:3.0:1789176467.786489:0:20924:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d7000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789176467.786505:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789176467.786515:0:20924:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac7e4d000): rc 0 00000020:00000080:3.0:1789176467.786517:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7e4d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789176467.786527:0:20924:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc1a741ccbae0 00000100:00080000:3.0:1789176467.786562:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176467.786566:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789176467.787365:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789176467.787374:0:20924:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1789176467.787571:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975857792:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789176467.787815:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789176467.787820:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789176467.787855:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789176467.787920:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789176467.788374:0:20924:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789176467.788618:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789176467.788622:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789176467.788635:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789176467.788701:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789176467.788715:0:20924:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789176467.788760:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f0bf720cd40) has no exports 00000100:00100000:1.0:1789176467.788914:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975857920:0@lo:9:umount.0 00000100:00100000:2.0:1789176467.789048:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176467.789072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176467.789105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975858048:0@lo:9:umount.0 00000100:00100000:1.0:1789176467.789127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176467.789169:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857920 00000100:00100000:1.0:1789176467.789178:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857920 00010000:00010000:2.0:1789176467.789208:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176467.789232:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975858048 00000100:00100000:1.0:1789176467.789235:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975858048 00000100:00100000:1.0:1789176467.789276:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176467.789286:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1876086975857920:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789176467.789330:0:19551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b90 00000100:00080000:1.0:1789176467.789342:0:19551:0:(import.c:65:import_set_state_nolock()) ffff9f0ac731c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176467.789580:0:19551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789176467.790067:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3641:x1876086975857920:12345-0@lo:9:umount.0 Request processed in 779us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176467.790077:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176467.790099:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176467.790107:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1876086975858048:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789176467.790124:0:19551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555c1c 00000100:00080000:1.0:1789176467.790132:0:19551:0:(import.c:65:import_set_state_nolock()) ffff9f0bd8ac0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176467.790158:0:19551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789176467.790235:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3641:x1876086975858048:12345-0@lo:9:umount.0 Request processed in 130us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176467.790242:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789176467.790919:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176467.790993:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789176467.791050:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789176467.791188:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176467.791196:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975857920:0@lo:9:umount.0 00000100:00080000:1.0:1789176467.791217:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789176467.791228:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789176467.791230:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176467.791232:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975858048:0@lo:9:umount.0 00010000:00010000:1.0:1789176467.791270:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176467.794442:0:17136:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789176467.794465:0:17136:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00080000:3.0:1789176467.795918:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789176467.795940:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac760c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789176467.796016:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7e4d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789176467.796047:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac760d800 for lustre-MDT0001 00000020:00000080:3.0:1789176467.796052:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bc52d7000 for lustre-MDT0001 00000100:00100000:3.0:1789176467.796103:0:17134:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789176467.796148:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975857792 00000100:00100000:3.0:1789176467.796159:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975857792 00010000:00010000:3.0:1789176467.796222:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176467.796334:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876086975857280:12345-0@lo:103:ldlm_bl.0 Request processed in 10900us (16636us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176467.796343:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176467.796371:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176467.796377:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876086975857408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789176467.796383:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176467 with bad export cookie 5427932470221035697 00000100:00100000:3.0:1789176467.796420:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876086975857408:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (16638us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176467.796426:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176467.796439:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789176467.796444:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1876086975857536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789176467.796448:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176467 with bad export cookie 5427932470221035697 00000100:00100000:3.0:1789176467.796481:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1876086975857536:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (11820us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176467.796487:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789176467.796499:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176467.796503:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1876086975857664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789176467.796508:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176467 with bad export cookie 5427932470221035697 00000100:00100000:3.0:1789176467.796532:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1876086975857664:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (11472us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176467.796537:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176467.796562:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789176467.796566:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876086975857792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789176467.796569:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176467 with bad export cookie 5427932470221035697 00000100:00100000:3.0:1789176467.796610:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876086975857792:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (7563us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176467.796615:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789176467.798079:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789176467.798089:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789176467.798094:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789176467.800817:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789176467.802980:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789176467.805745:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789176467.805752:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789176467.805763:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0beb56c700 x1876086975857280/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176483 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176467.805781:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0beb56df80 x1876086975857408/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176483 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176467.805790:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8519880 x1876086975857536/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176483 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176467.805801:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0beb56ca80 x1876086975857664/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176483 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176467.805809:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0beb56c000 x1876086975857792/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176483 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176467.806009:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f0ac85e3800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789176467.806040:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975857792:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789176467.806113:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f0ac85e3800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789176467.806141:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975857536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176467.806158:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975857664:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789176467.806507:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789176467.806511:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789176467.806512:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789176467.806517:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176467.806523:0:3644:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1789176467.806533:0:3644:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0ac85e3800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176467.806582:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776fb80 x1876086975858176/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176467.806616:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975857280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789176467.806638:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975857408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176467.806695:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6f15dd7-fbd0-4e86-8827-d477f7554462:3641:1876086975858176:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1789176467.806989:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086975858176 offset 0 length 520: 4 00000020:00080000:3.0:1789176467.808386:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f0bf720cd40) has no exports 00000020:01000000:0.0:1789176467.883967:0:20924:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0bfb907de0 - data ffff9f0bd8fd4bd0/ffff9f0bfbfd5400 00000020:01000000:0.0:1789176467.884179:0:20924:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7524d80 - data ffff9f0ac5c9aaf8/ffff9f0beb675c00 00000001:00000004:0.0:1789176467.897038:0:20924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1789176467.997655:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789176467.997669:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789176467.997679:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789176468.000962:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789176468.000972:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1789176468.000990:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176468.000992:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789176468.001320:0:17890:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789176468.001326:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1789176468.001338:0:17890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789176468.002255:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789176468.002260:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1789176468.002316:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176468.002319:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789176468.002564:0:17892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789176468.002570:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789176468.002580:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789176468.003773:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05559fa 00000020:00000080:1.0:1789176468.003787:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a00000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789176468.004619:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a0f 00000020:00000080:1.0:1789176468.004630:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c9e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.004816:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a00000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789176468.004927:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789176468.004937:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176468.004950:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789176468.004956:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9f0beec84d40) has no exports 00000004:01000000:1.0:1789176468.005185:0:20924:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789176468.005196:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a63 00000020:00000080:1.0:1789176468.005201:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0be01f2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.005265:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c9e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789176468.005323:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789176468.005328:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176468.005333:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789176468.005336:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9f0bf726cd40) has no exports 00000020:00000080:1.0:1789176468.005344:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a5c 00000020:00000080:1.0:1789176468.005348:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bffae8000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789176468.005363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be01f2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1789176468.005827:0:20924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789176468.005856:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789176468.005876:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1789176468.005883:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176468.005886:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789176468.005994:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffae8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789176468.006080:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176468.006089:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789176468.006096:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a4e 00000020:00000080:1.0:1789176468.006101:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bfd315800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.006171:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bffaed000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789176468.006180:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bfd314000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.006182:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd314000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789176468.006187:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789176468.006356:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789176468.006362:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176468.006367:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789176468.006370:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9f0ac7490000) has no exports 00000020:00000080:1.0:1789176468.006375:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a40 00000020:00000080:1.0:1789176468.006379:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bfd316800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789176468.006396:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd315800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1789176468.006943:0:20924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789176468.006950:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789176468.006954:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1789176468.006959:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176468.006962:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789176468.007070:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd316800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789176468.007246:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176468.007254:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789176468.007271:0:20924:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789176468.007278:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a32 00000020:00000080:1.0:1789176468.007284:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bfd310800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.007303:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0be01f6800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789176468.007310:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bffaec000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.007313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffaec000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789176468.007317:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789176468.007448:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789176468.007453:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176468.007458:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789176468.007462:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9f0ac7493380) has no exports 00000020:00000080:1.0:1789176468.007467:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a2b 00000020:00000080:1.0:1789176468.007471:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bfd312000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789176468.007490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd310800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789176468.007656:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd312000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789176468.008987:0:20924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789176468.009008:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176468.010264:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789176468.010281:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789176468.010368:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176468.010383:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176468.010442:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176468.010447:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176468.010454:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a06800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789176468.010460:0:20924:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a06800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789176468.010470:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789176468.010853:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd315000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789176468.010865:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bfd314800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176468.010879:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd314800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789176468.010885:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176468.012186:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a16 00000020:00000080:0.0:1789176468.012202:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c9c000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789176468.012218:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789176468.012225:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176468.012235:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789176468.012241:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f0bf72099c0) has no exports 00000020:00000080:0.0:1789176468.012280:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176468.012287:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789176468.012292:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a1d 00000020:00000080:3.0:1789176468.012298:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c9c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789176468.012298:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c9e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789176468.012306:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a05000/lustre-MDD0001_UUID 00000020:00000080:3.0:1789176468.012308:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a05000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:0.0:1789176468.012310:0:20924:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac7201000 from lustre-MDT0001, refs=2 00000020:01000000:3.0:1789176468.012315:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1789176468.012315:0:20924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac7201000 2 00000020:01000004:0.0:1789176468.012322:0:20924:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0ac7201000 from lustre-MDT0001 00000020:00000080:0.0:1789176468.012361:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176468.012366:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789176468.012369:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a05800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789176468.012371:0:20924:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a05800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789176468.012384:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789176468.012447:0:20924:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789176468.012452:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789176468.012455:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176468.012460:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789176468.012480:0:20924:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f0bd82f5000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:3.0:1789176468.012481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c9e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:0.0:1789176468.012498:0:20924:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9f0bfd6099c0) has exports, disconnecting them 00000020:00080000:0.0:1789176468.012504:0:20924:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f0bd82f5000), last request at 1789176385 00000020:00000080:0.0:1789176468.012509:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555a9b 00000020:00080000:0.0:1789176468.012519:0:20924:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bd82f5000): rc 0 00000020:00000080:0.0:1789176468.012523:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0bd82f5000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789176468.013793:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd82f5000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789176468.085078:0:20924:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789176468.085204:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789176468.085210:0:20924:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789176468.085401:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789176468.085496:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac749c800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789176468.085656:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176468.085666:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789176468.085673:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0be01f6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789176468.085678:0:20924:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be01f6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789176468.085690:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789176468.085899:0:20924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac7201000 1 00000020:00000080:1.0:1789176468.085908:0:20924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05559c2 00000020:00000080:1.0:1789176468.085917:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7204800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789176468.085932:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789176468.085938:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176468.085945:0:20924:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789176468.085951:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9f0ac7494d40) has no exports 00000020:00000080:3.0:1789176468.085954:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7204800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:0.0:1789176468.274010:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789176468.303791:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176468.303821:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789176468.303863:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7204000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789176468.303869:0:20924:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7204000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789176468.303884:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789176468.304035:0:20924:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0ac7200800 00000020:01000000:3.0:1789176468.304076:0:20924:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789176468.304081:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176468.304086:0:20924:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789176468.304091:0:20924:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9f0ac75d8000) has no exports 00000100:00100000:3.0:1789176468.304198:0:20724:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9f0bd91f8200:20724] 4 exiting: rc = 0 00000100:00100000:3.0:1789176468.304378:0:20145:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f0ac7030000:20145] 3 exiting: rc = 0 00000100:00100000:2.0:1789176468.304508:0:17150:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f0be01b8a00:17150] 1 exiting: rc = 0 00000100:00100000:2.0:1789176468.304689:0:17151:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f0bfd5cea00:17151] 2 exiting: rc = 0 00000100:00100000:1.0:1789176468.306632:0:17149:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f0ac71cbc00:17149] 0 exiting: rc = 1 00000100:00100000:3.0:1789176468.314792:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319561:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319576:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319582:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319589:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319595:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319601:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319611:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319646:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319653:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319660:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319666:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319673:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319679:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319685:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319691:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319697:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319704:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319710:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319716:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319721:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319727:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319732:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319739:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319746:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319752:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319759:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319764:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319770:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319777:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319784:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319790:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319796:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319804:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319822:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319852:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319863:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319870:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319877:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319883:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319889:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319895:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319901:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319922:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319928:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319936:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319943:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319949:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319955:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319960:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319965:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319971:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319976:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319982:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319988:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.319994:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320000:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320006:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320012:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320018:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320025:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320031:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320037:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176468.320043:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.337980:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f0ac671e800:17152] 0 exiting: rc = 1 00000100:00100000:1.0:1789176468.338176:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f0bfd5ce600:17153] 1 exiting: rc = 0 00000100:00100000:0.0:1789176468.339816:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339849:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339857:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339862:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339869:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339875:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339880:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339886:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339891:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339897:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339904:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339910:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339915:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339922:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339927:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339932:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339939:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339944:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339950:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339956:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339962:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339968:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339973:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339978:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339983:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.339989:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340019:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340026:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340033:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340040:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340112:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340120:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340126:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.340202:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342350:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342364:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342370:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342376:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342381:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342386:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342391:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342397:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342403:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342408:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342413:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342420:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342425:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342434:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342440:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342447:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342453:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342458:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342465:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342471:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342477:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342483:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342488:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342494:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342500:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342506:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342513:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342557:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342563:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.342569:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.346010:0:18392:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9f0ac5bfa800:18392] 2 exiting: rc = 0 00000100:00100000:0.0:1789176468.347911:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f0ac7769000:17155] 1 exiting: rc = 0 00000100:00100000:3.0:1789176468.351170:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f0ac7769800:17154] 0 exiting: rc = 1 00000100:00100000:1.0:1789176468.351397:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351420:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351428:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351434:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351441:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351448:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351463:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351470:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351476:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351498:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351506:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351513:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351519:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351526:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351545:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351552:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351579:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351585:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351595:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351602:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351608:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351629:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351639:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351647:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351657:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351666:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351673:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351680:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351689:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351698:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351707:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351713:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351721:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351740:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351748:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351754:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351761:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351768:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351775:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351781:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351788:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351796:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351803:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351820:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351828:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351962:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351971:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351979:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351986:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.351993:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352002:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352015:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352022:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352032:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352041:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352050:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352059:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352087:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352097:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352104:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352112:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352119:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352125:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.352132:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.374727:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f0ac7d43a00:17157] 1 exiting: rc = 0 00000100:00100000:3.0:1789176468.375131:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f0ac7d42600:17156] 0 exiting: rc = 1 00000100:00100000:0.0:1789176468.375742:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375752:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375760:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375766:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375772:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375778:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375784:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375789:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375796:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375812:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375819:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375825:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375867:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375874:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375880:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375886:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375891:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375897:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375903:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375910:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375915:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375921:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375926:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375932:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375939:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375946:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375953:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375960:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375965:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375972:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.375998:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376005:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376010:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376015:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376021:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376026:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376031:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376036:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376041:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376046:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376052:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376057:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376062:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376067:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376072:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376079:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376084:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376089:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376094:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376099:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376104:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376109:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376114:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376119:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376125:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376132:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376137:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376143:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376148:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376153:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376159:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376165:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376171:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.376176:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381070:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f0ac7d43000:17158] 0 exiting: rc = 1 00000100:00100000:2.0:1789176468.381215:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f0ac7d42e00:17159] 1 exiting: rc = 0 00000100:00100000:2.0:1789176468.381279:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381287:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381292:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381298:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381305:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381310:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381317:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381323:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381330:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381335:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381341:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381362:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381368:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381374:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381391:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381396:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381402:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381415:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381421:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381426:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381431:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381436:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381443:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381627:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381637:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381644:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381650:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381657:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381663:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381669:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381675:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381681:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381686:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381692:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381698:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381703:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381708:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381714:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381720:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381725:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381731:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381737:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381742:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381748:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381753:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381758:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381773:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381778:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381784:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381789:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381796:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381883:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381892:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381897:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381902:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381908:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381914:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381920:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381925:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381930:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381937:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381942:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381949:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.381955:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.382366:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f0ac7d42200:17161] 1 exiting: rc = 0 00000100:00100000:0.0:1789176468.387692:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f0ac7d42a00:17160] 0 exiting: rc = 1 00000100:00100000:2.0:1789176468.388058:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388068:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388073:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388079:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388084:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388090:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388096:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388101:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388107:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388112:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388118:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388123:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388128:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388134:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388140:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388146:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388160:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388165:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388170:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388176:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388181:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388187:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388193:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388198:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388203:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388208:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388213:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388218:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388223:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388229:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388234:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388240:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388245:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388253:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388259:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388264:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388269:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388275:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388280:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388285:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388290:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388295:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388301:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388306:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388312:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388318:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388324:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388329:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388335:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388340:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388346:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388360:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388365:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.388370:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390007:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390039:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390045:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390051:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390057:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390062:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390068:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390074:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390079:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176468.390085:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176468.392108:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f0ac7d43600:17162] 0 exiting: rc = 1 00000100:00100000:2.0:1789176468.392691:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f0ac7d43800:17164] 2 exiting: rc = 0 00000100:00100000:3.0:1789176468.393289:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f0ac7d42400:17163] 1 exiting: rc = 0 00000100:00100000:1.0:1789176468.393723:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393733:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393739:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393746:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393752:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393759:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393767:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393788:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.393796:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394234:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394250:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394257:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394263:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394270:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394277:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394284:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394291:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394297:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394304:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394311:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394317:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394323:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394347:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394353:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394360:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394366:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394777:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394789:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.394796:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395004:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395015:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395042:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395050:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395056:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395062:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395068:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395074:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395079:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395086:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395091:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395097:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395102:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395107:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395113:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395120:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395127:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395134:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395141:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395148:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395154:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395161:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395167:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395173:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395180:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395186:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395207:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395215:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395231:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395236:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395243:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395250:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395257:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395264:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176468.395280:0:20924:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789176468.412719:0:20924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176468.412740:0:20924:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789176468.412749:0:20924:0:(genops.c:885:class_export_put()) final put ffff9f0ac7e4b000/MDS_uuid 00000020:00000080:1.0:1789176468.412756:0:20924:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7e4b000/MDS_uuid for MDS 00000020:01000000:1.0:1789176468.412774:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789176468.413012:0:20924:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1789176468.529959:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789176468.529981:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789176468.529986:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176468.529997:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1789176468.530005:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789176468.530015:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac7c8c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176468.530075:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8721c00 x1876086975858304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176468.530619:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975858304:0@lo:38:kworker.0 00000400:00000100:2.0:1789176468.530705:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975858304 offset 0 length 520: 4 00000100:00080000:0.0:1789176468.531005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789176468.531010:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789176468.531013:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176468.531019:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1789176468.531025:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789176468.531031:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac760f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176468.531049:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8721880 x1876086975858560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176468.531093:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176468.531103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975858688:0@lo:400:kworker.0 00000100:00100000:3.0:1789176468.531561:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176468.531575:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975858432:0@lo:400:kworker.0 00000400:00000100:3.0:1789176468.531618:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975858432 offset 0 length 224: 4 00000400:00000100:0.0:1789176468.532255:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975858688 offset 0 length 224: 4 00000100:00100000:0.0:1789176468.532285:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975858560:0@lo:38:kworker.0 00000400:00000100:0.0:1789176468.532300:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975858560 offset 0 length 520: 4 00010000:00010000:3.0:1789176469.300401:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176470.331268:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176471.346799:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176472.370034:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789176473.154725:0:21127:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789176473.166613:0:21127:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789176473.166688:0:21127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176473.167058:0:21127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176473.167135:0:21127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176473.167147:0:21127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176473.167176:0:21127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789176473.167184:0:21127:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789176473.167222:0:21127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176473.167237:0:21127:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8721c00 x1876086975858304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789176488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176473.167259:0:21127:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789176473.167266:0:21127:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789176473.167368:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176473.167378:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176473.167465:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176473.167471:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176473.167482:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176473.167491:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176473.167498:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789176473.167510:0:17137:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789176473.167514:0:17137:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789176473.167532:0:17137:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:3.0:1789176473.167536:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176473.167545:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176473.167562:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176473.167564:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176473.167566:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176473.167588:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176473.167619:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789176473.167625:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975858304:0@lo:38:kworker.0 00000100:00080000:0.0:1789176473.167790:0:21127:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789176473.167798:0:21127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176473.167800:0:21127:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789176473.167804:0:21127:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789176473.168065:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176473.168140:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789176473.168252:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975858816:0@lo:400:kworker.0 00000400:00000100:1.0:1789176473.168350:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975858816 offset 0 length 224: 4 00000100:00080000:3.0:1789176473.171538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176473.171550:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176473.171682:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975858944:0@lo:400:kworker.0 00000400:00000100:3.0:1789176473.171761:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975858944 offset 0 length 224: 4 00000100:00080000:0.0:1789176473.172703:0:21127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789176473.172780:0:21127:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8720380 x1876086975858432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176484 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176473.172809:0:21127:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac776f800 x1876086975858816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176473.173846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975858432:0@lo:400:kworker.0 00000100:00100000:0.0:1789176473.175493:0:21127:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789176473.175517:0:21127:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789176473.176928:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975858816:0@lo:400:kworker.0 00000100:00080000:1.0:1789176473.178711:0:21127:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789176473.179109:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975859072:0@lo:39:umount.0 00000400:00000100:0.0:1789176473.179181:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975859072 offset 0 length 224: 4 00010000:00010000:1.0:1789176473.395490:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789176473.653110:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789176473.653120:0:18651:0:(genops.c:885:class_export_put()) final put ffff9f0ac7318800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789176473.655113:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7318800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789176473.655182:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac731c800 for lustre-OST0000 00000001:00100000:2.0:1789176473.655540:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789176473.655545:0:19468:0:(genops.c:885:class_export_put()) final put ffff9f0bd8ac6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789176473.655607:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd8ac6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789176473.655642:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bd8ac0800 for lustre-OST0001 00010000:00010000:3.0:1789176474.418259:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176475.442203:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176476.467814:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176477.298182:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176467/real 1789176467] req@ffff9f0ac776fb80 x1876086975858176/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789176477 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176477.298221:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac776fb80 x1876086975858176/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789176477 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176477.298246:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176477.298273:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789176477.298277:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6f15dd7-fbd0-4e86-8827-d477f7554462:3641:1876086975858176:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1789176477.298350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176477.298366:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789176477.298391:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176477.298406:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 589 00000100:00080000:1.0:1789176477.298412:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176477.298422:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0ac85e3800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176477.298460:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d5aa00 x1876086975859200/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176477.298640:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6f15dd7-fbd0-4e86-8827-d477f7554462:3641:1876086975859200:0@lo:250:kworker.0 00000400:00000100:0.0:1789176477.298696:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086975859200 offset 0 length 520: 4 00000100:00080000:1.0:1789176477.298778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176477.298783:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176477.298921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975859328:0@lo:400:kworker.0 00000400:00000100:3.0:1789176477.298949:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975859328 offset 0 length 224: 4 00010000:00010000:1.0:1789176477.490263:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176478.515599:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176479.538106:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176480.562485:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176481.586606:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176482.354131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176482.354142:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176482.354145:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176482.354148:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789176482.354618:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975859456:0@lo:400:kworker.0 00000400:00000100:0.0:1789176482.354703:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975859456 offset 0 length 224: 4 00010000:00010000:3.0:1789176482.610030:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176483.442035:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176473/real 1789176473] req@ffff9f0be7d5bb80 x1876086975859072/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176483 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176483.442067:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0be7d5bb80 x1876086975859072/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176483 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176483.442095:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789176483.442116:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975859072:0@lo:39:umount.0 00000100:00080000:2.0:1789176483.442175:0:21127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789176483.442186:0:21127:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789176483.442195:0:21127:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789176483.444002:0:21127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444026:0:21127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444034:0:21127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444435:0:21127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444655:0:21127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176483.444668:0:21127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444677:0:21127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444684:0:21127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176483.444691:0:21127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.448696:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176483.448801:0:21127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789176483.448815:0:21127:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1789176483.448860:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.448876:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176483.448880:0:19554:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789176483.448893:0:21127:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1789176483.448893:0:19554:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789176483.448901:0:21127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789176483.448915:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176483.448925:0:21127:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:0.0:1789176483.448927:0:19554:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789176483.448934:0:21127:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9f0bf726b380) has no exports 10000000:01000000:0.0:1789176483.448934:0:19554:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176483.448940:0:19554:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789176483.448945:0:19554:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789176483.448966:0:19554:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:0.0:1789176483.448971:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.448978:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.448996:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1789176483.449199:0:21127:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9f0bf726b380) has no exports 00010000:00010000:0.0:1789176483.449808:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.449822:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176483.449827:0:19554:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.449967:0:19554:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176483.449974:0:19554:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176483.449979:0:19554:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789176483.449982:0:19554:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789176483.449997:0:19554:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789176483.450020:0:19554:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:0.0:1789176483.450032:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.450041:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176483.450068:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176483.450070:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176483.450074:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789176483.455248:0:21127:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7f34cc0 - data ffff9f0bf8336798/ffff9f0bef414400 00010000:00010000:3.0:1789176483.455886:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789176483.456167:0:21127:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac85b2e40 - data ffff9f0bd23826c0/ffff9f0beb567c00 00100000:10000000:2.0:1789176483.467974:0:21127:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789176483.486994:0:21127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b20 00000020:00000080:3.0:1789176483.487178:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0bdfc65800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789176483.487204:0:21127:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bc7a04000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789176483.487208:0:21127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bc7a04000 2 00000020:01000004:3.0:1789176483.487211:0:21127:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0bc7a04000 from lustre-OST0000 00000020:00000080:3.0:1789176483.487239:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176483.487249:0:21127:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789176483.487251:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0bdfc67000/lustre-OST0000_UUID 00000020:00000080:3.0:1789176483.487254:0:21127:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bdfc67000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789176483.487262:0:21127:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789176483.487711:0:21127:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789176483.487717:0:21127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789176483.487721:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176483.487726:0:21127:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176483.487734:0:21127:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f0bd163c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176483.487740:0:21127:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9f0bf72699c0) has exports, disconnecting them 00000020:00080000:3.0:1789176483.488118:0:21127:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f0bd163c800), last request at 1789176400 00000020:00000080:3.0:1789176483.488136:0:21127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b4a 00000020:00080000:3.0:1789176483.488154:0:21127:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bd163c800): rc 0 00000020:00000080:3.0:1789176483.488160:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0bd163c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789176483.488336:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bdfc65800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789176483.489343:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd163c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789176483.507639:0:21127:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789176483.507648:0:21127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176483.507653:0:21127:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789176483.507661:0:21127:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789176483.507891:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176483.507900:0:21127:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789176483.507906:0:21127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789176483.507913:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176483.507917:0:21127:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789176483.507925:0:21127:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f0bd163a800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789176483.507932:0:21127:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9f0bd16f8000) has exports, disconnecting them 00000020:00080000:0.0:1789176483.507936:0:21127:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f0bd163a800), last request at 1789176400 00000020:00000080:0.0:1789176483.507941:0:21127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b5f 00000020:00080000:0.0:1789176483.507954:0:21127:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bd163a800): rc 0 00000020:00000080:0.0:1789176483.507959:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0bd163a800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789176483.509576:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7c8c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789176483.509604:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c88000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789176483.509607:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c88000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789176483.509615:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789176483.509678:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd163a800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789176483.513887:0:21127:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789176483.513895:0:21127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789176483.513899:0:21127:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789176483.513907:0:21127:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176483.513939:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7c8f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789176483.514154:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176483.514165:0:21127:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789176483.514170:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0bd163f000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789176483.514174:0:21127:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd163f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789176483.514185:0:21127:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789176483.514247:0:21127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bc7a04000 1 00000020:00000080:1.0:1789176483.514252:0:21127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555afd 00000020:00000080:1.0:1789176483.514258:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0ac599f000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789176483.514266:0:21127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789176483.514274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac599f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789176483.514284:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176483.514288:0:21127:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789176483.514292:0:21127:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9f0bf720b380) has no exports 00000020:00000080:1.0:1789176483.648288:0:21127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176483.648301:0:21127:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789176483.648307:0:21127:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a03800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789176483.648312:0:21127:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a03800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789176483.648324:0:21127:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789176483.648458:0:21127:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0bc7a03000 00000020:02000400:1.0:1789176483.648505:0:21127:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789176483.663276:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789176484.419488:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176468/real 1789176468] req@ffff9f0ac8721500 x1876086975858688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176484.461695:0:3643:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f0ac8721500 x1876086975858688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176484.461710:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a2000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789176484.461714:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789176484.490263:0:3643:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789176484.490304:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176484.490312:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176484.490315:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176484.490319:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176484.490322:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176484.490325:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789176484.490329:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176484.490339:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1789176484.490349:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0beb5a2000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176484.490388:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776dc00 x1876086975859584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176484.491620:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975858688:0@lo:400:kworker.0 00000100:00100000:1.0:1789176484.496971:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975859584:0@lo:38:kworker.0 00000400:00000100:1.0:1789176484.497187:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975859584 offset 0 length 520: 4 00010000:00010000:3.0:1789176484.659925:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176485.685005:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176486.705933:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789176487.420395:0:21329:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789176487.435416:0:21329:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789176487.435499:0:21329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.435513:0:21329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.435521:0:21329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.435531:0:21329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.435547:0:21329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789176487.435551:0:21329:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789176487.435575:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789176487.435585:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8721880 x1876086975858560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789176488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176487.435598:0:21329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789176487.435604:0:21329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789176487.435610:0:21329:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789176487.435614:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789176487.435618:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8721880 x1876086975858560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789176488 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176487.435625:0:21329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789176487.435731:0:21329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:0.0:1789176487.435788:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176487.435806:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176487.435813:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176487.435816:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176487.435826:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176487.435859:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176487.435865:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176487.435867:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789176487.435869:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789176487.435883:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:0.0:1789176487.435886:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176487.435893:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176487.435903:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176487.435905:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176487.435906:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176487.435939:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975858560:0@lo:38:kworker.0 00000100:00080000:2.0:1789176487.437868:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789176487.437881:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac776ea00 x1876086975858944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176487.437906:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0be7d5ad80 x1876086975859328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176487.437931:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0be7d5b100 x1876086975859456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176498 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176487.437943:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac776dc00 x1876086975859584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789176494 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176487.438077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975859456:0@lo:400:kworker.0 00000100:00100000:3.0:1789176487.438134:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975858944:0@lo:400:kworker.0 00000100:00100000:2.0:1789176487.438158:0:21329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789176487.438164:0:21329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789176487.438482:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176487.438505:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1789176487.438509:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975859584:0@lo:38:kworker.0 00000100:00100000:0.0:1789176487.439376:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975859328:0@lo:400:kworker.0 00000100:00080000:2.0:1789176487.440625:0:21329:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a2000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789176487.441093:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789176487.441096:0:21329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789176487.441101:0:21329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789176487.442195:0:21329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442212:0:21329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442219:0:21329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442225:0:21329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442340:0:21329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176487.442349:0:21329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442356:0:21329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442379:0:21329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176487.442384:0:21329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.442426:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176487.442433:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.442440:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176487.442443:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.442451:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176487.442465:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176487.442470:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789176487.442473:0:19553:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1789176487.442484:0:19553:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:2.0:1789176487.442585:0:21329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789176487.442591:0:21329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1789176487.442595:0:21329:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789176487.442628:0:21329:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789176487.442632:0:21329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789176487.442636:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176487.442642:0:21329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789176487.442646:0:21329:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9f0bf30999c0) has no exports 00000020:00080000:2.0:1789176487.442671:0:21329:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9f0bf30999c0) has no exports 00010000:00010000:3.0:1789176487.444111:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.444131:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.444150:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176487.444154:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.444160:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176487.444163:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.444172:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176487.444179:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176487.444184:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789176487.444187:0:19553:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789176487.444189:0:19553:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789176487.444213:0:19553:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:3.0:1789176487.444216:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.444222:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176487.444234:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176487.444236:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789176487.444685:0:21329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7f343c0 - data ffff9f0bd20ad0d8/ffff9f0bef416c00 00000020:01000000:2.0:1789176487.444853:0:21329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7388c60 - data ffff9f0bf827d1b0/ffff9f0be736b400 00010000:00010000:0.0:1789176487.445475:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176487.445624:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789176487.457749:0:21329:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789176487.475652:0:21329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555bba 00000020:00000080:3.0:1789176487.475665:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0ac7171000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789176487.475686:0:21329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bef409800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789176487.475689:0:21329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bef409800 2 00000020:01000004:3.0:1789176487.475692:0:21329:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0bef409800 from lustre-OST0001 00000020:00000080:3.0:1789176487.475728:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176487.475739:0:21329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789176487.475743:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0be01f7800/lustre-OST0001_UUID 00000020:00000080:3.0:1789176487.475745:0:21329:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be01f7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789176487.475751:0:21329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789176487.475876:0:21329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS 00010000:00010000:3.0:1789176487.475893:0:21329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176487.475905:0:21329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176487.475911:0:21329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789176487.475914:0:21329:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789176487.475917:0:21329:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789176487.475931:0:21329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:3.0:1789176487.475935:0:21329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789176487.475948:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7171000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:3.0:1789176487.475958:0:21329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176487.475965:0:21329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176487.475970:0:21329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789176487.475972:0:21329:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789176487.475974:0:21329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789176487.475983:0:21329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0ac85e3800 00010000:00010000:3.0:1789176487.475986:0:21329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789176487.476003:0:21329:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789176487.476007:0:21329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789176487.476009:0:21329:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789176487.476011:0:21329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789176487.476015:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789176487.476027:0:21329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0be7d5aa00 x1876086975859200/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789176492 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789176487.476269:0:21329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789176487.476272:0:21329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1789176487.476356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6f15dd7-fbd0-4e86-8827-d477f7554462:3641:1876086975859200:0@lo:250:kworker.0 10000000:01000000:3.0:1789176487.477158:0:21329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789176487.477168:0:21329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05558a3 00000020:00000080:3.0:1789176487.477174:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0ac7e4b800/a6f15dd7-fbd0-4e86-8827-d477f7554462 00000020:01000000:3.0:1789176487.477187:0:21329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.130@tcp (flags='') 00000020:00000080:3.0:1789176487.477194:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176487.477199:0:21329:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789176487.477203:0:21329:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9f0ac7ca4d40) has no exports 10000000:01000000:1.0:1789176487.477249:0:17146:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789176487.477616:0:21329:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.130@tcp: client import never connected 00000100:00080000:3.0:1789176487.477628:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789176487.477631:0:21329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789176487.477633:0:21329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789176487.477635:0:21329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789176487.477669:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176487.477674:0:21329:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.130@tcp (uuid a6f15dd7-fbd0-4e86-8827-d477f7554462) 00000020:01000000:3.0:1789176487.477679:0:21329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789176487.477683:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176487.477687:0:21329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176487.477692:0:21329:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f0ac7608800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176487.477697:0:21329:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9f0ac75db380) has exports, disconnecting them 00000020:00080000:3.0:1789176487.477701:0:21329:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f0ac7608800), last request at 1789176416 00000020:00000080:3.0:1789176487.477704:0:21329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555be4 00000020:00080000:3.0:1789176487.477714:0:21329:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac7608800): rc 0 00000020:00000080:3.0:1789176487.477718:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0ac7608800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789176487.478341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7e4b800/a6f15dd7-fbd0-4e86-8827-d477f7554462 for MGC192.168.203.130@tcp 00000020:00000080:0.0:1789176487.478350:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac85e3800 for MGC192.168.203.130@tcp 00000020:00000080:0.0:1789176487.478356:0:8:0:(genops.c:885:class_export_put()) final put ffff9f0ac85e5800/a6f15dd7-fbd0-4e86-8827-d477f7554462 00000020:00000080:0.0:1789176487.478363:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac85e5800/a6f15dd7-fbd0-4e86-8827-d477f7554462 for MGC192.168.203.130@tcp 00000020:01000000:0.0:1789176487.478367:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.130@tcp (a6f15dd7-fbd0-4e86-8827-d477f7554462) 00000020:00000080:0.0:1789176487.478904:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7608800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789176487.479932:0:21329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789176487.479938:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176487.479942:0:21329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789176487.479949:0:21329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789176487.480190:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176487.480199:0:21329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789176487.480205:0:21329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789176487.480210:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176487.480214:0:21329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789176487.480220:0:21329:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f0ac7cca800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789176487.480231:0:21329:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9f0bfd60cd40) has exports, disconnecting them 00000020:00080000:0.0:1789176487.480235:0:21329:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f0ac7cca800), last request at 1789176416 00000020:00000080:0.0:1789176487.480239:0:21329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555bf9 00000020:00080000:0.0:1789176487.480262:0:21329:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac7cca800): rc 0 00000020:00000080:0.0:1789176487.480268:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cca800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789176487.480670:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac760f000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789176487.480677:0:8:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a28000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789176487.480680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a28000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789176487.480689:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789176487.480744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cca800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789176487.481461:0:21329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789176487.481466:0:21329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789176487.481470:0:21329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789176487.481475:0:21329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176487.481507:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0beb5a2000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789176487.533862:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789176487.533937:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789176487.534208:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789176487.534352:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1789176487.534600:0:17133:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f0ac596f600:17133] 1 exiting: rc = 0 00000100:00100000:0.0:1789176487.534663:0:17132:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f0ac7626600:17132] 0 exiting: rc = 1 00000100:00100000:1.0:1789176487.534740:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.535204:0:17135:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f0ac596fa00:17135] 1 exiting: rc = 0 00000100:00100000:0.0:1789176487.535263:0:17136:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f0ac596f200:17136] 2 exiting: rc = 0 00000100:00100000:2.0:1789176487.535364:0:20925:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f0ac7102e00:20925] 3 exiting: rc = 0 00000100:00100000:3.0:1789176487.535449:0:17134:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f0ac596e600:17134] 0 exiting: rc = 1 00000100:00100000:1.0:1789176487.535594:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535600:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535607:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535611:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535616:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535634:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535640:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535645:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535651:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535657:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535663:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535669:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535675:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535680:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535687:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535693:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535699:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535704:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535709:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535714:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535720:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535726:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535731:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535737:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535743:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535749:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535755:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535760:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535767:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535773:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535778:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535784:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535790:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535795:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535801:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535807:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535813:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535819:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535824:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535867:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535881:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535886:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535891:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535895:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535901:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535906:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535911:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535916:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535921:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535926:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535931:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535937:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535941:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.535948:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536186:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536192:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536197:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536202:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536207:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536212:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536216:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536222:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536227:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176487.536232:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789176487.537248:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176487.537258:0:21329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789176487.537264:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0beb5a5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789176487.537268:0:21329:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0beb5a5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789176487.537278:0:21329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789176487.537325:0:21329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bef409800 1 00000020:00000080:1.0:1789176487.537331:0:21329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0555b9e 00000020:00000080:1.0:1789176487.537338:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0ac7318000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789176487.537359:0:21329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789176487.537363:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176487.537375:0:21329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789176487.537380:0:21329:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9f0bf7208000) has no exports 00000020:00000080:3.0:1789176487.540129:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7318000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789176487.561714:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176487.561729:0:21329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789176487.561735:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0bef409000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789176487.561741:0:21329:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bef409000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789176487.561753:0:21329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789176487.562301:0:21329:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0bef40e000 00000020:01000000:2.0:1789176487.562324:0:21329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789176487.562328:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176487.562333:0:21329:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789176487.562337:0:21329:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9f0bf7268000) has no exports 00000020:00000080:2.0:1789176487.562367:0:21329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176487.562374:0:21329:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789176487.562377:0:21329:0:(genops.c:885:class_export_put()) final put ffff9f0ac599b800/OSS_uuid 00000020:00000080:2.0:1789176487.562380:0:21329:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac599b800/OSS_uuid for OSS 00000020:01000000:2.0:1789176487.562384:0:21329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789176487.562586:0:18657:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f0bc2e97200:18657] 2 exiting: rc = 0 00000100:00100000:1.0:1789176487.562753:0:19551:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9f0ac651ba00:19551] 4 exiting: rc = 0 00000100:00100000:1.0:1789176487.562818:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f0bfd6b1600:18656] 1 exiting: rc = 0 00000100:00100000:1.0:1789176487.562887:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f0beb503200:18654] 0 exiting: rc = 1 00000100:00100000:0.0:1789176487.563275:0:19181:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f0ac645f800:19181] 3 exiting: rc = 0 00000100:00100000:2.0:1789176487.563382:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563391:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563396:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563412:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563418:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563423:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563427:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563433:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563438:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563443:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563448:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563453:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563457:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563463:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563467:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563472:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563477:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563481:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563486:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563502:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563508:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563514:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563518:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563523:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563528:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563533:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563538:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563543:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563550:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563570:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563574:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563580:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563585:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563590:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563595:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563605:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563610:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563615:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563619:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563635:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563641:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563645:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563650:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563655:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563659:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563664:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563668:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563673:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563678:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563683:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563688:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563693:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563698:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563703:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563708:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563713:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563718:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563734:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563741:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563745:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563750:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563755:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563760:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.563765:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1789176487.566750:0:17145:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789176487.567481:0:20489:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9f0ac9058e00:20489] 2 exiting: rc = 0 00000100:00100000:1.0:1789176487.567762:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f0beb584600:18658] 0 exiting: rc = 1 00000100:00100000:1.0:1789176487.567809:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f0ac5bc9600:18659] 1 exiting: rc = 0 00000100:00100000:0.0:1789176487.568156:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568163:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568168:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568174:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568179:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568184:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568189:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568193:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568198:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568202:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568207:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568211:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568216:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568221:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568226:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568231:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568235:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568240:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568244:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568249:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568254:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568258:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568263:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568281:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568285:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568290:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568294:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568298:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568303:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568308:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568313:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568319:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568323:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568328:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568333:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568337:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568342:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568347:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568351:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568356:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568361:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568366:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568370:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568375:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568379:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568384:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568388:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568393:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568412:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568419:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568424:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568429:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568434:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568439:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568445:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568449:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568454:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568459:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568471:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568476:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568481:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568486:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568500:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.568507:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176487.570237:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f0ac75e5000:18661] 1 exiting: rc = 0 00000100:00100000:0.0:1789176487.570448:0:20290:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9f0bef413400:20290] 3 exiting: rc = 0 00000100:00100000:3.0:1789176487.570814:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f0bf71f5000:18660] 0 exiting: rc = 1 00000100:00100000:3.0:1789176487.571122:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f0ac75e4200:18662] 2 exiting: rc = 0 00000100:00100000:0.0:1789176487.571262:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571270:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571277:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571283:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571290:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571296:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571301:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571307:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571312:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571318:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571323:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571329:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571335:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571341:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571347:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571352:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571358:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571363:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571369:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571374:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571379:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571386:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571391:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571396:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571411:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571417:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571437:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571445:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571468:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571475:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571480:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571486:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571566:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571574:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571580:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571587:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571593:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571598:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571603:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571610:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571615:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571621:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571694:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571702:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571708:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571714:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571720:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571725:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571731:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571736:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571758:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571765:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571771:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571776:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571781:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571786:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571792:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571797:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571812:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571819:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.571825:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.572908:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.572932:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.573068:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.582047:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f0ac75e4400:18663] 0 exiting: rc = 1 00000100:00100000:1.0:1789176487.582261:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f0ac7627600:18664] 1 exiting: rc = 0 00000100:00100000:0.0:1789176487.582450:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582459:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582473:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582480:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582486:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582502:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582509:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582514:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582519:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582523:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582528:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582533:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582539:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582544:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582550:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582554:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582559:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582565:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582570:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582576:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582582:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582587:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582592:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582597:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582603:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582609:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582614:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582619:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582623:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582763:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582768:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582773:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582778:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582783:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582801:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582810:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582816:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582822:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582924:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582933:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582938:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582943:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.582948:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583149:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583155:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583160:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583166:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583171:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583176:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583181:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583186:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583191:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583197:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583202:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583207:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583212:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583218:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583224:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583229:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583234:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583239:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583245:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583250:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.583260:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176487.584652:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f0beb616200:18666] 1 exiting: rc = 0 00000100:00100000:2.0:1789176487.587074:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f0be01ee600:18665] 0 exiting: rc = 1 00000100:00100000:3.0:1789176487.587210:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587220:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587226:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587255:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587262:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587267:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587272:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587278:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587284:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587375:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587381:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587387:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587393:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587409:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587417:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587437:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587444:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587452:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587459:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587465:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587470:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587478:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587484:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587552:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587560:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587566:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587572:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587595:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587602:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587609:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587615:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587621:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587636:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587643:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587649:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587655:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587663:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587670:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587675:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587697:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587705:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587711:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587716:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587722:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587734:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587740:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587746:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587752:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587757:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587762:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587767:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587773:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587792:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587799:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587805:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587811:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587817:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587822:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587827:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587878:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587884:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587890:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587895:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176487.587901:0:21329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789176487.604568:0:21329:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789176508.666442:0:22093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789176520.129964:0:22693:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789176520.129970:0:22693:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789176520.129972:0:22693:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789176520.130299:0:22693:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0bfbff9000 00000020:01000004:2.0:1789176520.130314:0:22693:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789176520.130321:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789176520.130334:0:22693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f0bd16f99c0) 00000020:00000080:2.0:1789176520.130348:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789176520.253276:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789176520.255089:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789176520.261249:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789176520.279651:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.280129:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.280635:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.281099:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.281349:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.281681:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.282113:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.282434:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.282665:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.283319:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.285087:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.285491:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.286659:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.287400:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.287810:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.288535:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.289241:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.289789:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789176520.291213:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789176520.292528:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.299305:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.300824:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.301236:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.301463:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789176520.301817:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.305035:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789176520.305648:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.307265:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789176520.308687:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.309811:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789176520.317239:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789176520.318531:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789176520.320485:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1789176520.320879:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1789176520.321133:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789176520.322241:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789176520.322585:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789176520.323059:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789176520.323357:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789176520.328459:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789176520.329410:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789176520.333187:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789176520.338315:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789176520.340664:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789176520.342561:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789176520.343358:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789176520.343778:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789176520.344644:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789176520.345217:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789176520.346396:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1789176520.348376:0:22693:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789176520.348820:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789176520.349019:0:22693:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789176520.349036:0:22693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055610f 00000020:01000004:3.0:1789176520.349045:0:22693:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789176520.349065:0:22693:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789176520.349071:0:22693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0bfbff9000 from MGS 00000020:01000004:3.0:1789176520.349075:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789176520.349088:0:22693:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f0bf30999c0) 00000020:00000080:3.0:1789176520.349100:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789176520.349187:0:22693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bfbff9000 from MGS, refs=2 00080000:01000000:3.0:1789176520.349192:0:22693:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789176520.349197:0:22693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055611d 00000100:00100000:3.0:1789176520.350038:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789176520.350904:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789176520.350919:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789176520.354073:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789176520.354093:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789176520.357607:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176520.358365:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789176520.358374:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789176520.359159:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789176520.359181:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789176520.365115:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789176520.365132:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789176520.366203:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176520.366209:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176520.366211:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176520.366539:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176520.366648:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176520.366652:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176520.373201:0:22693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789176520.375295:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789176520.401275:0:22693:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789176520.406887:0:22705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789176520.407087:0:22693:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789176520.407180:0:22693:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789176520.410314:0:22693:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789176520.410771:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176520.411031:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789176520.411039:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789176520.419465:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789176520.419484:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789176520.422655:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789176520.422673:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789176520.424330:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789176520.424360:0:22693:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:2.0:1789176520.424369:0:22693:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789176520.424415:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:2.0:1789176520.424435:0:22693:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (ffff9f0bd16fcd40) 00000020:00000080:2.0:1789176520.424453:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789176520.424665:0:22693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac67d0800@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176520.424931:0:22693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:2.0:1789176520.424939:0:22693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789176520.425687:0:22710:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789176520.426702:0:22711:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789176520.426797:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid de6bc3dc-0fde-4253-a7e7-b570e971a5be) 00000020:00000080:3.0:1789176520.426825:0:22693:0:(genops.c:1385:class_connect()) connect: client de6bc3dc-0fde-4253-a7e7-b570e971a5be, cookie 0x4b53e3d2c055612b 00000100:00080000:3.0:1789176520.426986:0:22693:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789176520.426994:0:22693:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0ac67d0800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176520.427040:0:22693:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776ea00 x1876086975859712/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176520.427067:0:22693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import de6bc3dc-0fde-4253-a7e7-b570e971a5be->MGS 00000020:01000004:3.0:1789176520.427096:0:22693:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789176520.427102:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789176520.427116:0:22693:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f0bf309b380) 00000020:00000080:3.0:1789176520.427131:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789176520.427144:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3641:1876086975859712:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789176520.427264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176520.428114:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975859712 00000100:00100000:0.0:1789176520.428126:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975859712 00000100:00100000:0.0:1789176520.428179:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176520.428188:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1876086975859712:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789176520.428231:0:22707:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de6bc3dc-0fde-4253-a7e7-b570e971a5be@0@lo t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:0.0:1789176520.428270:0:22707:0:(genops.c:1385:class_connect()) connect: client de6bc3dc-0fde-4253-a7e7-b570e971a5be, cookie 0x4b53e3d2c0556139 00000100:00080000:0.0:1789176520.428656:0:22707:0:(import.c:65:import_set_state_nolock()) ffff9f0bef450000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176520.428984:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+5:3641:x1876086975859712:12345-0@lo:250:mount.lustre.0 Request processed in 794us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.428997:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176520.429111:0:3641:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789176520.429122:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1789176520.429141:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789176520.429148:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789176520.429153:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac67d0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789176520.429156:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789176520.429179:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789176520.429186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3641:1876086975859712:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789176520.440582:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176520.447145:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789176520.447157:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789176520.455259:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176520.455280:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789176520.456072:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789176520.456081:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789176520.459719:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176520.460163:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789176520.460183:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789176520.462350:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789176520.462364:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789176520.534959:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176520.535202:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789176520.535210:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789176520.555703:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789176520.555717:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789176520.556431:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789176520.556642:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789176520.556648:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789176520.557660:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789176520.557669:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789176520.568325:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176520.569162:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789176520.569180:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789176520.570156:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789176520.570165:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789176520.570806:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176520.571111:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789176520.571117:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789176520.571927:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789176520.571934:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789176520.595632:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176520.595940:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789176520.595947:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789176520.601235:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176520.601249:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789176520.609694:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789176520.609711:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789176520.612141:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789176520.612185:0:22693:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789176520.612192:0:22693:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789176520.612299:0:22693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789176520.612341:0:22693:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789176520.612346:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789176520.612347:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176520.612349:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176520.612350:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176520.612351:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176520.612352:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176520.612354:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176520.612355:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176520.612357:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176520.612359:0:22693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789176520.612361:0:22693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789176520.612363:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789176520.612365:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176520.612366:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176520.612367:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176520.612368:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176520.612370:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176520.612371:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176520.612372:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176520.612373:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176520.612374:0:22693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789176520.612400:0:22693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789176520.612499:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975859840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789176520.615068:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.615504:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176520.617557:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975859840 00000100:00100000:1.0:1789176520.617575:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975859840 00000100:00100000:1.0:1789176520.617635:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176520.617645:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+5:22693:x1876086975859840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789176520.617861:0:22709:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789176520.617865:0:22709:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789176520.617868:0:22709:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789176520.618628:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789176520.622488:0:22709:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1789176520.627175:0:22731:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789176520.627188:0:22731:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789176520.627192:0:22731:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789176520.627195:0:22731:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789176520.629176:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789176520.633874:0:22709:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789176520.633917:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789176520.638441:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+5:22693:x1876086975859840:12345-0@lo:253:mount.lustre.0 Request processed in 20783us (23365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.638468:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176520.638587:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975859840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176520.638677:0:22693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789176520.638682:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176520.638684:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789176520.638702:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176520.638704:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176520.638705:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176520.638707:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176520.638709:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176520.638711:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789176520.638713:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176520.638714:0:22693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176520.641437:0:22693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0bfbff9000 from lustre-MDT0000 10000000:01000000:1.0:1789176520.641570:0:22693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789176520.641574:0:22693:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789176520.641581:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f0bd16fcd40 10000000:01000000:1.0:1789176520.641587:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176520.641599:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0bd16fcd40 from 1 10000000:01000000:1.0:1789176520.641611:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789176520.641673:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.641688:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.641702:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176520.641746:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975859968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789176520.641885:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176520.641949:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfb834000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176520.642206:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975859968 00000100:00100000:2.0:1789176520.642216:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975859968 00000100:00100000:2.0:1789176520.642277:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789176520.642288:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+5:22693:x1876086975859968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176520.642305:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176520.642324:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43ba00/0x4b53e3d2c0556147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556140 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.642353:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43ba00/0x4b53e3d2c0556147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556140 expref: 6 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.642366:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43ba00/0x4b53e3d2c0556147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556140 expref: 6 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.642376:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43ba00, rc 0) 00000100:00100000:2.0:1789176520.642436:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+6:22693:x1876086975859968:12345-0@lo:101:mount.lustre.0 Request processed in 150us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.642448:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176520.642576:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975859968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176520.642596:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.642624:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176520.642705:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176520.642737:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176520.642770:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176520.642855:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860096 00000100:00100000:1.0:1789176520.642860:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860096 00000100:00100000:1.0:1789176520.642891:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176520.642900:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+6:22693:x1876086975860096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176520.643113:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+6:22693:x1876086975860096:12345-0@lo:501:mount.lustre.0 Request processed in 101us (262us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789176520.643130:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176520.643488:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789176520.643526:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789176520.643557:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.643567:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176520.643578:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0bfbff9000 10000000:01000000:3.0:1789176520.643585:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789176520.643590:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0bfbff9000 10000000:01000000:3.0:1789176520.643593:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789176520.643596:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0bfbff9000 from 1 10000000:01000000:3.0:1789176520.643609:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789176520.643639:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.643647:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.643657:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176520.643684:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176520.643719:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176520.643766:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176520.643873:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860224 00000100:00100000:2.0:1789176520.643879:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860224 00000100:00100000:2.0:1789176520.643915:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176520.643923:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+6:22693:x1876086975860224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176520.643932:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176520.643948:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43a000/0x4b53e3d2c0556155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055614e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.643993:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43a000/0x4b53e3d2c0556155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055614e expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.644114:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43a000/0x4b53e3d2c0556155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055614e expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.644124:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43a000, rc 0) 00000100:00100000:2.0:1789176520.644160:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+7:22693:x1876086975860224:12345-0@lo:101:mount.lustre.0 Request processed in 238us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.644176:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176520.644376:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176520.644390:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556155 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644399:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556155 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176520.644412:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789176520.644416:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556155 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644422:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c055614e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556155 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176520.644429:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789176520.644433:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176520.644439:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0bfbff9000 10000000:01000000:3.0:1789176520.644441:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789176520.644446:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789176520.644448:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789176520.644463:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644470:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644484:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176520.644498:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176520.644526:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176520.644549:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.644570:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860352 00000100:00100000:3.0:1789176520.644574:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860352 00000100:00100000:3.0:1789176520.644656:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176520.644665:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+7:22693:x1876086975860352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176520.644673:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176520.644684:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0556163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055615c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644699:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0556163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055615c expref: 8 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644708:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0556163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055615c expref: 8 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.644715:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495200, rc 0) 00000100:00100000:3.0:1789176520.645228:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+8:22693:x1876086975860352:12345-0@lo:101:mount.lustre.0 Request processed in 561us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.645235:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176520.645281:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176520.645295:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556163 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.645313:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556163 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176520.645377:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176520.645405:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176520.645423:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.645439:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860480 00000100:00100000:3.0:1789176520.645444:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860480 00000100:00100000:3.0:1789176520.645464:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176520.645471:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+8:22693:x1876086975860480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176520.645623:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22693:x1876086975860480:12345-0@lo:501:mount.lustre.0 Request processed in 152us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.645631:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176520.645663:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176520.645692:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176520.646293:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.646432:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860608 00000100:00100000:2.0:1789176520.646439:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860608 00000100:00100000:2.0:1789176520.646504:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176520.646511:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22693:x1876086975860608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176520.646711:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176520.647607:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22693:x1876086975860608:12345-0@lo:503:mount.lustre.0 Request processed in 1088us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.647618:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176520.648127:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975860608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176520.649395:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22732:1876086975860736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176520.649495:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176520.649583:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfb834000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176520.649689:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860736 00000100:00100000:2.0:1789176520.649699:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860736 00000100:00100000:2.0:1789176520.650241:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176520.650255:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22732:x1876086975860736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176520.652006:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22732:x1876086975860736:12345-0@lo:502:llog_process_th.0 Request processed in 1739us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.652022:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176520.652390:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22732:1876086975860736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789176520.652443:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176520.652459:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176520.652462:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789176520.652471:0:22732:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789176520.652475:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176520.652497:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f0ac75db380) 00000020:00000080:1.0:1789176520.652523:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789176520.652529:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789176520.653156:0:22732:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789176520.653181:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0556171 00000020:00000080:1.0:1789176520.653633:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789176520.653646:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176520.653653:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176520.653655:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789176520.653658:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176520.653664:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176520.653665:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789176520.653669:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176520.653684:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f0ac75d8000) 00000020:00000080:1.0:1789176520.653704:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789176520.653708:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789176520.653710:0:22732:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789176520.653714:0:22732:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789176520.653724:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789176520.653827:0:22732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bfbff9000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789176520.653891:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f0ac75d99c0) 00000020:00000080:1.0:1789176520.653900:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789176520.653958:0:22732:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789176520.653964:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0556186 00000020:00000080:1.0:1789176520.654068:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789176520.654074:0:22732:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789176520.654078:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b53e3d2c055618d 00080000:01000000:1.0:1789176520.654084:0:22732:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789176520.654088:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0556194 00010000:00010000:1.0:1789176520.755781:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789176520.758445:0:22732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1789176520.759820:0:22732:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789176520.762934:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f0bd16fb380) 00000020:00000080:2.0:1789176520.762979:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789176520.763083:0:22732:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789176520.763091:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05561a2 00000020:00000080:1.0:1789176520.768959:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789176520.776341:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b53e3d2c05561a9 00000020:00000080:3.0:1789176520.776896:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789176520.776912:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176520.776919:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.776922:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789176520.776925:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789176520.776927:0:22732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789176520.776929:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176520.776930:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176520.776941:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789176520.776944:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.776946:0:22732:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789176520.776949:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176520.776964:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.776966:0:22732:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789176520.776971:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789176520.777084:0:22732:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789176520.777103:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176520.777106:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.777108:0:22732:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789176520.777110:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176520.777114:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.777115:0:22732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789176520.777118:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789176520.777123:0:22732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:3.0:1789176520.777149:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176520.777173:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f0bf309cd40) 00000020:00000080:3.0:1789176520.777192:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789176520.777198:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789176520.777253:0:22732:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789176520.777259:0:22732:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789176520.777265:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05561b7 00010000:00080000:3.0:1789176520.777296:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bc7154000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1789176520.781636:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789176520.796895:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176520.796911:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789176520.798551:0:22732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789176520.798580:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05561be 00000100:00080000:3.0:1789176520.798593:0:22732:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789176520.798660:0:22732:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc7154000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176520.798703:0:22732:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776f100 x1876086975860864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176520.798737:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789176520.798817:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176520.798822:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.798824:0:22732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789176520.798827:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789176520.798854:0:22732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789176520.798856:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176520.798858:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176520.798860:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789176520.798863:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.798864:0:22732:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789176520.798868:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789176520.798872:0:22732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789176520.798875:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176520.798876:0:22732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789176520.798879:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789176520.798883:0:22732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1789176520.798909:0:22732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789176520.798912:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176520.798936:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f0bf3098000) 00000020:00000080:3.0:1789176520.798950:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000100:00100000:1.0:1789176520.799092:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975860864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176520.799160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176520.799373:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176520.799382:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975860992:0@lo:400:kworker.0 00000100:00100000:0.0:1789176520.799415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176520.799447:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860992 00000100:00100000:0.0:1789176520.799454:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860992 00000100:00100000:0.0:1789176520.799495:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176520.799504:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:3642:x1876086975860992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176520.799549:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:3642:x1876086975860992:12345-0@lo:400:kworker.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.799567:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176520.799692:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975860992:0@lo:400:kworker.0 00000100:00100000:3.0:1789176520.799810:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975860864 00000100:00100000:3.0:1789176520.799814:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975860864 00000100:00100000:3.0:1789176520.799916:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176520.799933:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975860864:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789176520.799947:0:22719:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:2.0:1789176520.801931:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789176520.802061:0:22732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789176520.802069:0:22732:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789176520.802079:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05561cc 00010000:00080000:2.0:1789176520.802125:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfb8c1800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176520.802369:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789176520.814160:0:22732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789176520.814790:0:22732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789176520.826300:0:22732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176520.826632:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:3.0:1789176520.829090:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975860864:12345-0@lo:38:llog_process_th.0 Request processed in 29153us (29916us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176520.829118:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789176520.829181:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176520.829348:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789176520.829355:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975860864:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789176520.839713:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789176520.846701:0:22739:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789176520.846711:0:22739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789176520.847896:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789176520.847916:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789176520.847971:0:22732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789176520.847997:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05561d3 00000100:00080000:1.0:1789176520.848011:0:22732:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176520.848018:0:22732:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bfb8c1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176520.848062:0:22732:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d5a300 x1876086975861120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176520.848131:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789176520.848143:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975861120:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789176520.848237:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975861120 offset 0 length 520: 4 00000020:01000000:1.0:1789176520.848335:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176520.848340:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176520.848342:0:22732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789176520.848346:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789176520.848357:0:22732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789176520.848359:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789176520.848361:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789176520.848363:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789176520.848367:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176520.848368:0:22732:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789176520.848371:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789176520.848376:0:22732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789176520.848380:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176520.848381:0:22732:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789176520.848383:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789176520.848387:0:22732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1789176520.848415:0:22732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789176520.848418:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176520.848435:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f0ac75dcd40) 00000020:00000080:1.0:1789176520.848449:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789176520.848454:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789176520.848532:0:22732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789176520.848539:0:22732:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789176520.848546:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05561e1 00010000:00080000:1.0:1789176520.848594:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac85e7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176520.849026:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789176520.849115:0:22732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789176520.849133:0:22732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789176520.852641:0:22732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176520.852923:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789176520.853588:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1789176520.854577:0:22741:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789176520.854585:0:22741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789176520.855498:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789176520.855515:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789176520.855570:0:22732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789176520.855597:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05561e8 00000100:00080000:0.0:1789176520.855612:0:22732:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176520.855620:0:22732:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0ac85e7000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176520.855668:0:22732:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8722300 x1876086975861248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789176520.855754:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975861248:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789176520.855874:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975861248 offset 0 length 520: 4 00000100:00080000:0.0:1789176520.858260:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789176520.858430:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176520.858441:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176520.858444:0:22732:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789176520.858448:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176520.858471:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176520.858473:0:22732:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789176520.858477:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789176520.858480:0:22732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789176520.858483:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176520.858485:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176520.858487:0:22732:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789176520.858489:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176520.858492:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176520.858493:0:22732:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789176520.858497:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789176520.858565:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22732:1876086975861376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176520.858669:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176520.858698:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6776180 going to sleep for 11 seconds 00000100:00100000:2.0:1789176520.858948:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975861376 00000100:00100000:2.0:1789176520.858959:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975861376 00000100:00100000:2.0:1789176520.859011:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176520.859021:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22732:x1876086975861376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176520.859188:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22732:x1876086975861376:12345-0@lo:502:llog_process_th.0 Request processed in 168us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.859198:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176520.859496:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22732:1876086975861376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789176520.859533:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176520.859540:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176520.859542:0:22732:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789176520.859546:0:22732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789176520.861296:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789176520.861341:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789176520.861421:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556163 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.861436:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c055615c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556163 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176520.863295:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bfbff9000 from 1 10000000:01000000:2.0:1789176520.863307:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176520.863383:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.863397:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.863412:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.863471:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176520.863568:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.863627:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176520.863795:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975861504 00000100:00100000:0.0:1789176520.863807:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975861504 00000100:00100000:0.0:1789176520.863899:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176520.863911:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+9:22693:x1876086975861504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176520.863928:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176520.863950:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05561ef expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176520.863979:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176520.863992:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176520.864012:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:0.0:1789176520.864061:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+10:22693:x1876086975861504:12345-0@lo:101:mount.lustre.0 Request processed in 152us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.864068:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176520.864316:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176520.864334:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.864344:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.864978:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861632:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789176520.865045:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.865087:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176520.866319:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975861632 00000100:00100000:0.0:1789176520.866335:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975861632 00000100:00100000:0.0:1789176520.866406:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176520.866417:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+10:22693:x1876086975861632:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789176520.866445:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789176520.866453:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789176520.866583:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+10:22693:x1876086975861632:12345-0@lo:256:mount.lustre.0 Request processed in 168us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.866592:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176520.866717:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861632:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789176520.867507:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789176520.867732:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.867747:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176520.874760:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfbff9000 from 1 10000000:01000000:2.0:1789176520.874774:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176520.874866:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.874881:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.874896:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.874931:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176520.875033:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.875111:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.876321:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975861760 00000100:00100000:3.0:1789176520.876337:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975861760 00000100:00100000:3.0:1789176520.876427:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789176520.876439:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+10:22693:x1876086975861760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176520.876459:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176520.876484:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05561fd expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.876518:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 11 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.877391:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 11 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.877402:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495c00, rc 0) 00000100:00100000:3.0:1789176520.877504:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22693:x1876086975861760:12345-0@lo:101:mount.lustre.0 Request processed in 1066us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.877514:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176520.877610:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176520.877645:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.877658:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.877754:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176520.878100:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.878147:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176520.878338:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975861888 00000100:00100000:0.0:1789176520.878350:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975861888 00000100:00100000:0.0:1789176520.878472:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176520.878483:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22693:x1876086975861888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176520.878699:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22693:x1876086975861888:12345-0@lo:501:mount.lustre.0 Request processed in 218us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.878707:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176520.878823:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975861888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176520.878924:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176520.878977:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.879583:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789176520.879624:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862016 00000100:00100000:1.0:1789176520.879632:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862016 00000100:00100000:1.0:1789176520.879669:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176520.879678:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22693:x1876086975862016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176520.879822:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22693:x1876086975862016:12345-0@lo:503:mount.lustre.0 Request processed in 145us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176520.879863:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176520.879969:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176520.880648:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22743:1876086975862144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176520.880704:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.880740:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789176520.880794:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862144 00000100:00100000:1.0:1789176520.880801:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862144 00000100:00100000:1.0:1789176520.880827:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176520.880869:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22743:x1876086975862144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176520.881563:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22743:x1876086975862144:12345-0@lo:502:llog_process_th.0 Request processed in 692us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176520.881574:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176520.881857:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22743:1876086975862144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176520.881894:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176520.881907:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.881910:0:22743:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789176520.881918:0:22743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bfbff9000 00000020:00000080:2.0:1789176520.881921:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789176520.881932:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176520.881934:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.881943:0:22743:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789176520.881946:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176520.881949:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.881951:0:22743:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789176520.881954:0:22743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bfbff9000 00000020:00000080:2.0:1789176520.881956:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789176520.882612:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176520.882619:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.882620:0:22743:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789176520.882623:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176520.882626:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.882627:0:22743:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789176520.882630:0:22743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bfbff9000 00000020:00000080:2.0:1789176520.882632:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789176520.888326:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176520.888344:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.888347:0:22743:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789176520.888352:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176520.888357:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176520.888358:0:22743:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789176520.888364:0:22743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bfbff9000 00000020:00000080:2.0:1789176520.888366:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789176520.888489:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22743:1876086975862272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176520.888594:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.888661:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176520.889069:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862272 00000100:00100000:0.0:1789176520.889081:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862272 00000100:00100000:0.0:1789176520.889153:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176520.889162:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22743:x1876086975862272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176520.889344:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22743:x1876086975862272:12345-0@lo:502:llog_process_th.0 Request processed in 182us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.889359:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176520.889437:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22743:1876086975862272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789176520.889473:0:22743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176520.889480:0:22743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176520.889482:0:22743:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789176520.889486:0:22743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789176520.892152:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789176520.892224:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176520.892252:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.892267:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176520.892486:0:22693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789176520.892490:0:22693:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0bfbff9000 10000000:01000000:2.0:1789176520.892494:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0bfbff9000 10000000:01000000:2.0:1789176520.892499:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789176520.892508:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bfbff9000 from 1 10000000:01000000:2.0:1789176520.892513:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176520.892566:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.892575:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.892589:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.892622:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176520.892711:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.892778:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176520.893011:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862400 00000100:00100000:0.0:1789176520.893021:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862400 00000100:00100000:0.0:1789176520.893081:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176520.893094:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22693:x1876086975862400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176520.893111:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176520.893129:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9ca00/0x4b53e3d2c0556212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055620b expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176520.893182:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9ca00/0x4b53e3d2c0556212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055620b expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176520.893203:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9ca00/0x4b53e3d2c0556212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055620b expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176520.893214:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9ca00, rc 0) 00000100:00100000:0.0:1789176520.893267:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975862400:12345-0@lo:101:mount.lustre.0 Request processed in 177us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176520.893275:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176520.898543:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176520.898587:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556212 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.898603:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556212 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.898718:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176520.898952:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.899050:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.900713:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862528 00000100:00100000:3.0:1789176520.900728:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862528 00000100:00100000:3.0:1789176520.900805:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176520.900818:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975862528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176520.905928:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975862528:12345-0@lo:501:mount.lustre.0 Request processed in 5103us (6970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.905944:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176520.906373:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176520.907133:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176520.908178:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.908362:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.909298:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862656 00000100:00100000:3.0:1789176520.909312:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862656 00000100:00100000:3.0:1789176520.909380:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176520.909392:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975862656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176520.909609:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975862656:12345-0@lo:503:mount.lustre.0 Request processed in 220us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.909618:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176520.909961:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975862656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176520.910319:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22748:1876086975862784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176520.910366:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176520.910936:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc51d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.911025:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862784 00000100:00100000:3.0:1789176520.911033:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862784 00000100:00100000:3.0:1789176520.911078:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176520.911087:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22748:x1876086975862784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176520.911219:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22748:x1876086975862784:12345-0@lo:502:llog_process_th.0 Request processed in 134us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.911226:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789176520.911570:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22748:1876086975862784:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789176520.911664:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789176520.911692:0:22748:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f0bfd60b380) 00000020:00000080:0.0:1789176520.911720:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789176520.913556:0:22748:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bfbff9000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789176520.913571:0:22748:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bfbff9000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789176520.913575:0:22748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bfbff9000 4 00010000:00080000:0.0:1789176520.913627:0:22748:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bd17c1800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176520.930941:0:22748:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789176520.931154:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789176520.931214:0:22748:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789176520.931228:0:22748:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b53e3d2c0556220 00000100:00080000:1.0:1789176520.931239:0:22748:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176520.931247:0:22748:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0bd17c1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176520.931283:0:22748:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d59f80 x1876086975862912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176520.931315:0:22748:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789176520.931403:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975862912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176520.931483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176520.932337:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975862912 00000100:00100000:1.0:1789176520.932349:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975862912 00000100:00100000:1.0:1789176520.932394:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176520.932402:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975862912:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176520.932478:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975862912:12345-0@lo:38:llog_process_th.0 Request processed in 74us (993us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789176520.932487:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176520.932549:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176520.932571:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bd17c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176520.932583:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789176520.932588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975862912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176520.932995:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22748:1876086975863040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176520.933059:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176520.933087:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535000 going to sleep for 11 seconds 00000100:00100000:3.0:1789176520.933597:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863040 00000100:00100000:3.0:1789176520.933604:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863040 00000100:00100000:3.0:1789176520.933645:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176520.933654:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22748:x1876086975863040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176520.933943:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22748:x1876086975863040:12345-0@lo:502:llog_process_th.0 Request processed in 289us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.933951:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176520.933988:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22748:1876086975863040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176520.934043:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22748:1876086975863168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176520.934080:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176520.934099:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535000 going to sleep for 11 seconds 00000100:00100000:1.0:1789176520.934112:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863168 00000100:00100000:1.0:1789176520.934115:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863168 00000100:00100000:1.0:1789176520.934141:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789176520.934148:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22748:x1876086975863168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176520.934255:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22748:x1876086975863168:12345-0@lo:502:llog_process_th.0 Request processed in 106us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176520.934262:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176520.934464:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22748:1876086975863168:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789176520.934487:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789176520.934871:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789176520.934905:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789176520.934923:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556212 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.934933:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ac00/0x4b53e3d2c055620b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556212 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789176520.934989:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789176520.934992:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176520.934995:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176520.934996:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176520.934997:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176520.934999:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176520.935001:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176520.935004:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176520.935011:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176520.935821:0:22693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789176520.935826:0:22693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789176520.935850:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789176520.935852:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176520.935853:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176520.935854:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176520.935855:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176520.935857:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176520.935858:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176520.935859:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176520.935860:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176520.935861:0:22693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789176520.935886:0:22693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789176520.935903:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975863296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789176520.935958:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176520.935989:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc51d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176520.936432:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863296 00000100:00100000:0.0:1789176520.936441:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863296 00000100:00100000:0.0:1789176520.936495:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176520.936505:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975863296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789176520.936533:0:22709:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789176520.936547:0:22709:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789176520.942888:0:22709:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789176520.943041:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789176520.943697:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789176520.943704:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789176520.943891:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.943913:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.944475:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.944533:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.944912:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176520.944926:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975863424:0@lo:104: 00000100:00100000:1.0:1789176520.944990:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176520.945382:0:22730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176520.945775:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22693:x1876086975863296:12345-0@lo:253:mount.lustre.0 Request processed in 9270us (9815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176520.945787:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176520.946160:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22693:1876086975863296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789176520.946204:0:22693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789176520.946208:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789176520.946210:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789176520.946212:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176520.946213:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176520.946215:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176520.946216:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176520.946217:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789176520.946219:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789176520.946222:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176520.946224:0:22693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789176520.946251:0:22693:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789176520.946328:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863424 00000100:00100000:3.0:1789176520.946340:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863424 00000100:00100000:3.0:1789176520.946588:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176520.946599:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975863424:12345-0@lo:104: 00010000:00010000:3.0:1789176520.946619:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176520.946686:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176520.946692:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975863424:12345-0@lo:104: Request processed in 96us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176520.946698:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176520.947092:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975863424:0@lo:104: 00010000:00010000:1.0:1789176520.947114:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.953509:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176520.953519:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.953532:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176520.953537:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.953548:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176520.953556:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176520.954490:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789176520.954534:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.954541:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176520.954776:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.954786:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b600/0x4b53e3d2c05561ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05561f6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.954804:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176520.954806:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176520.954808:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176520.954898:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975863552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176520.954962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176520.955042:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863552 00000100:00100000:2.0:1789176520.955050:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863552 00010000:00010000:2.0:1789176520.955077:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176520.955106:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176520.955114:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:3644:x1876086975863552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176520.955126:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176520.955131:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955142:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955175:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9dc00/0x4b53e3d2c05561f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05561ef expref: 12 pid: 22707 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955190:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955198:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789176520.955214:0:22699:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011510252s 00010000:00010000:2.0:1789176520.955218:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955225:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955233:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955239:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955245:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176520.955249:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955255:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955268:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176520.955285:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176520.955317:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:3644:x1876086975863552:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176520.955325:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176520.955357:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975863552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176520.955555:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.955575:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176520.955582:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c0556227 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789176520.966754:0:22693:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:3.0:1789176520.972159:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789176520.972232:0:22754:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:3.0:1789176520.972238:0:22754:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:3.0:1789176520.975133:0:22755:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789176520.975537:0:22755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176520.977605:0:22755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789176520.977684:0:22755:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1789176520.978022:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1789176520.981261:0:22756:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f0ac776ea00 x1876086975863680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176520.981276:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000040:01000000:0.0:1789176520.981683:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789176520.981722:0:22693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789176520.982264:0:22693:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789176520.982275:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789176520.982314:0:22693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176520.983439:0:22693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789176520.985684:0:22693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789176520.985745:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789176520.988054:0:22693:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789176520.988582:0:22693:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1789176520.990695:0:22693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789176520.992507:0:22693:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789176520.992546:0:22693:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc1a74189f988 00100000:10000000:0.0:1789176520.992563:0:22693:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789176520.993784:0:22693:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789176520.993805:0:22693:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789176520.993824:0:22693:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789176520.993972:0:22693:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789176520.998313:0:22693:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176520.998605:0:22693:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176521.393958:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789176521.586903:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176521.586911:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bfbff9000 from 11 10000000:01000000:1.0:1789176521.586916:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176521.586967:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176521.586980:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176521.586991:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176521.587017:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975863808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176521.587088:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176521.587133:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176521.587230:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863808 00000100:00100000:3.0:1789176521.587238:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863808 00000100:00100000:3.0:1789176521.587396:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789176521.587405:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+11:22711:x1876086975863808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176521.587418:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176521.587433:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055622e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176521.587457:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176521.587468:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176521.587477:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495e00, rc 0) 00000100:00100000:3.0:1789176521.587811:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22711:x1876086975863808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176521.587819:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176521.591446:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975863808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176521.591481:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176521.591495:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176521.591578:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975863936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789176521.591651:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176521.591691:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7738840 going to sleep for 11 seconds 00000100:00100000:1.0:1789176521.591910:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863936 00000100:00100000:1.0:1789176521.591918:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863936 00000100:00100000:1.0:1789176521.591972:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789176521.591981:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22711:x1876086975863936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789176521.591999:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176521.592013:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176521.592016:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789176521.592110:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:22711:x1876086975863936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176521.592118:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789176521.592989:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975863936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789176521.593036:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789176521.593045:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176521.593055:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176521.979992:0:22750:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789176521.980004:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176521.990133:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789176521.990145:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789176522.034277:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:0.0:1789176522.418213:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789176523.001034:0:22750:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789176523.001043:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176523.001161:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789176523.001204:0:22750:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176523.001337:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1789176523.059991:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1789176523.443353:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176524.087097:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:0.0:1789176524.466989:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176525.105957:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1789176525.490050:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176525.677008:0:22998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789176526.129905:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000100:00080000:2.0:1789176526.392879:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789176526.392886:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789176526.392890:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176526.392899:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:2.0:1789176526.392905:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789176526.392912:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc7154000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176526.392935:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0beb56ce00 x1876086975864192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176526.392953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176526.392957:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176526.392960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176526.392963:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176526.392966:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789176526.392969:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789176526.392971:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bd17c1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176526.392976:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0bd17c1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176526.392989:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0beb56f800 x1876086975864320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176526.393023:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176526.393039:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975864064:0@lo:400:kworker.0 00000100:00100000:2.0:1789176526.393103:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176526.393721:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975864064 00000100:00100000:3.0:1789176526.393730:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975864064 00000100:00100000:3.0:1789176526.393776:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176526.393785:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:3644:x1876086975864064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176526.393868:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:3644:x1876086975864064:12345-0@lo:400:kworker.0 Request processed in 83us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176526.393875:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176526.393924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975864064:0@lo:400:kworker.0 00000100:00100000:0.0:1789176526.395796:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864192:0@lo:38:kworker.0 00000100:00100000:0.0:1789176526.395889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176526.395926:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975864320:0@lo:38:kworker.0 00000100:00100000:0.0:1789176526.395951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176526.396040:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975864320 00000100:00100000:0.0:1789176526.396047:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975864320 00000100:00100000:0.0:1789176526.396077:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176526.396084:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975864320:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789176526.396107:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:0.0:1789176526.396152:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b53e3d2c055623c 00000100:00100000:1.0:1789176526.397561:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975864192 00000100:00100000:1.0:1789176526.397573:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975864192 00000100:00100000:1.0:1789176526.397606:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176526.397613:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975864192:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789176526.397630:0:22720:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789176526.397695:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975864192:12345-0@lo:38:kworker.0 Request processed in 81us (1805us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176526.397703:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00100000:0.0:1789176526.398008:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789176526.398502:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176526.398508:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176526.398512:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864192:0@lo:38:kworker.0 00000100:00080000:0.0:1789176526.400588:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9f0bd17c3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176526.400707:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876086975864320:12345-0@lo:38:kworker.0 Request processed in 4619us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176526.400719:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789176526.403763:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0beb56f800 x1876086975864320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176526.403785:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789176526.403793:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789176526.403799:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789176526.403802:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bd17c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176526.403809:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975864320:0@lo:38:kworker.0 00010000:00010000:1.0:1789176526.516214:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176526.671626:0:23050:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176526.671807:0:23050:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176527.157193:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1789176527.543098:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789176527.611335:0:23101:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176527.611536:0:23101:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176528.178452:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:1.0:1789176528.567588:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176529.203425:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1789176529.587209:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176530.244179:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000100:00100000:0.0:1789176530.482633:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176520/real 1789176520] req@ffff9f0ac8722300 x1876086975861248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176530.482661:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8722300 x1876086975861248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176530.482670:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176520/real 1789176520] req@ffff9f0be7d5a300 x1876086975861120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176530.482681:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0be7d5a300 x1876086975861120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176530.482711:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176530.482731:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176530.482735:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975861248:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789176530.482741:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176530.482746:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176530.482748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975861120:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789176530.485012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789176530.485018:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789176530.485021:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176530.485029:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:1.0:1789176530.485035:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1789176530.485042:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1789176530.485042:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc7154000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176530.485066:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d58a80 x1876086975864576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176530.485081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176530.485085:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789176530.485086:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176530.485090:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:1.0:1789176530.485092:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176530.485105:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bfb8c1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176530.485117:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d59500 x1876086975864704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176530.485125:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176530.485128:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789176530.485129:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176530.485132:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:1.0:1789176530.485135:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176530.485138:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0ac85e7000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176530.485147:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d5a680 x1876086975864832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176530.485179:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3643:1876086975864448:0@lo:400:kworker.0 00000100:00100000:3.0:1789176530.485367:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176530.485418:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975864960:0@lo:400:kworker.0 00000100:00100000:3.0:1789176530.485454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176530.485690:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864576:0@lo:38:kworker.0 00000100:00100000:0.0:1789176530.485722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176530.485749:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864704:0@lo:8:kworker.0 00000400:00000100:0.0:1789176530.485766:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975864704 offset 0 length 520: 4 00000100:00100000:0.0:1789176530.485776:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864832:0@lo:8:kworker.0 00000400:00000100:0.0:1789176530.485794:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975864832 offset 0 length 520: 4 00000100:00100000:1.0:1789176530.485805:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975864448 00000100:00100000:1.0:1789176530.485814:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975864448 00000100:00100000:1.0:1789176530.485880:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789176530.485890:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:3643:x1876086975864448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176530.485942:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:3643:x1876086975864448:12345-0@lo:400:kworker.0 Request processed in 53us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176530.485949:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789176530.485986:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975864960 00000100:00100000:1.0:1789176530.485990:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975864960 00000100:00100000:1.0:1789176530.486016:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176530.486023:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975864960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176530.486054:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975864960:12345-0@lo:400:kworker.0 Request processed in 32us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176530.486060:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789176530.486108:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0be7d58000 x1876086975864960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176530.486121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975864960:0@lo:400:kworker.0 00000100:00100000:1.0:1789176530.486132:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3643:1876086975864448:0@lo:400:kworker.0 00000100:00100000:3.0:1789176530.486592:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975864576 00000100:00100000:3.0:1789176530.486598:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975864576 00000100:00100000:3.0:1789176530.486621:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176530.486626:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975864576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789176530.486642:0:22720:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789176530.519871:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975864576:12345-0@lo:38:kworker.0 Request processed in 33237us (34141us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789176530.519889:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789176530.520005:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176530.520011:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789176530.520015:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864576:0@lo:38:kworker.0 00010000:00010000:2.0:1789176530.613025:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176531.255220:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1789176531.634370:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176532.276320:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:2.0:1789176532.661960:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789176533.236255:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789176533.298088:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1789176533.682113:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789176533.925180:0:23447:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789176533.925185:0:23447:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789176533.925187:0:23447:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789176533.925349:0:23447:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0ac599b800 00000020:01000004:2.0:1789176533.925369:0:23447:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789176533.925383:0:23447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789176533.925402:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f0bd16f8000) 00000020:00000080:2.0:1789176533.925421:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789176533.976603:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789176533.977146:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789176533.980042:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789176533.982134:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789176533.982627:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789176533.984379:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789176533.984989:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789176533.985269:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789176533.985732:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789176533.986880:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789176533.988139:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789176533.988729:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789176533.989552:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789176533.990454:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789176533.995655:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789176533.997286:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789176533.998889:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789176534.001286:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789176534.002089:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789176534.002862:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789176534.003702:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789176534.006330:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789176534.008160:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789176534.008805:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789176534.009805:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789176534.014810:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789176534.016394:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789176534.017155:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789176534.018537:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789176534.022188:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789176534.022697:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789176534.025124:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789176534.025601:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789176534.026434:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789176534.027127:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789176534.027353:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789176534.028051:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789176534.028270:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789176534.028533:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789176534.028889:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789176534.029108:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789176534.029307:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789176534.029557:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789176534.039145:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789176534.041997:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789176534.043041:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:3.0:1789176534.048370:0:23447:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789176534.048678:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789176534.048693:0:23447:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789176534.048965:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c055624a 00000020:01000004:3.0:1789176534.048977:0:23447:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789176534.049006:0:23447:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789176534.049010:0:23447:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789176534.049018:0:23447:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789176534.049052:0:23447:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789176534.049057:0:23447:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789176534.057550:0:23447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789176534.057590:0:23447:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789176534.057594:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789176534.057596:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176534.057602:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176534.057603:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176534.057604:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176534.057605:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176534.057606:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176534.057608:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176534.057609:0:23447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176534.057612:0:23447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789176534.057614:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789176534.057616:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176534.057617:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176534.057618:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176534.057619:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176534.057620:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176534.057621:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176534.057622:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176534.057622:0:23447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176534.058778:0:23447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789176534.058800:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789176534.058883:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.059008:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc294df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176534.061816:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865088 00000100:00100000:2.0:1789176534.061920:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865088 00000100:00100000:2.0:1789176534.062010:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176534.062022:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:23447:x1876086975865088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789176534.062056:0:22709:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789176534.062059:0:22709:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789176534.062066:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789176534.064803:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:23447:x1876086975865088:12345-0@lo:253:mount.lustre.0 Request processed in 2772us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.064822:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789176534.064875:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176534.064899:0:23447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789176534.064903:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176534.064905:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176534.064906:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176534.064907:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176534.064909:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176534.064910:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176534.064911:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176534.064913:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176534.064914:0:23447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176534.064936:0:23447:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac599b800 from lustre-MDT0001 10000000:01000000:1.0:1789176534.064965:0:23447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789176534.064968:0:23447:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789176534.064974:0:23447:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0bd16fcd40 local copy 00010000:00010000:1.0:1789176534.064985:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176534.065103:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176534.065161:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.066548:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf26580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176534.068003:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865216 00000100:00100000:2.0:1789176534.068016:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865216 00000100:00100000:2.0:1789176534.068087:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789176534.068097:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:23447:x1876086975865216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176534.068233:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:23447:x1876086975865216:12345-0@lo:501:mount.lustre.0 Request processed in 137us (3071us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176534.068241:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176534.068380:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865216:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789176534.068404:0:23447:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789176534.068432:0:23447:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789176534.068440:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.068451:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176534.068495:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0ac599b800 10000000:01000000:3.0:1789176534.068500:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789176534.068505:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f0bd16fcd40 10000000:01000000:3.0:1789176534.068508:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789176534.068511:0:23447:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f0bd16fcd40 from 1 10000000:01000000:3.0:1789176534.068513:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789176534.068543:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.068552:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.068562:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176534.068581:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176534.068615:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176534.068792:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.072762:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865344 00000100:00100000:1.0:1789176534.072776:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865344 00000100:00100000:0.0:1789176534.075919:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176534.075932:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+12:23447:x1876086975865344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176534.075950:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176534.075971:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0556258 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556251 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.075999:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0556258 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556251 expref: 13 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.076010:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0556258 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556251 expref: 13 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.076038:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d200, rc 0) 00000100:00100000:0.0:1789176534.076118:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+13:23447:x1876086975865344:12345-0@lo:101:mount.lustre.0 Request processed in 188us (7501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.076125:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176534.076225:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176534.076245:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556258 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.076255:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556258 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176534.076277:0:23447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789176534.076285:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556258 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.076304:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495400/0x4b53e3d2c0556251 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556258 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176534.076315:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0ac599b800 10000000:01000000:3.0:1789176534.076320:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789176534.076324:0:23447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0ac599b800 from 1 10000000:01000000:3.0:1789176534.076327:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789176534.076352:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.076359:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.076368:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176534.076387:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176534.076419:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176534.080707:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176534.080911:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865472 00000100:00100000:2.0:1789176534.080921:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865472 00000100:00100000:2.0:1789176534.080969:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789176534.080978:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+13:23447:x1876086975865472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176534.080993:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176534.081010:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43a200/0x4b53e3d2c0556266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055625f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.081036:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43a200/0x4b53e3d2c0556266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055625f expref: 14 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.081059:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43a200/0x4b53e3d2c0556266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055625f expref: 14 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.081068:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43a200, rc 0) 00000100:00100000:2.0:1789176534.081140:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+14:23447:x1876086975865472:12345-0@lo:101:mount.lustre.0 Request processed in 163us (4719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176534.081147:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176534.081159:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176534.081176:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556266 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.081186:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556266 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176534.081203:0:23447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789176534.081221:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556266 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.081236:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494600/0x4b53e3d2c055625f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556266 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176534.081243:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789176534.081248:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176534.081254:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0ac599b800 10000000:01000000:3.0:1789176534.081257:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789176534.081261:0:23447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789176534.081264:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789176534.081285:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.081293:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.081302:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176534.081318:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176534.081347:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176534.081364:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176534.084432:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865600 00000100:00100000:2.0:1789176534.084447:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865600 00000100:00100000:2.0:1789176534.084499:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789176534.084509:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+14:23447:x1876086975865600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176534.084524:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176534.084543:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43b000/0x4b53e3d2c0556274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055626d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.084571:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43b000/0x4b53e3d2c0556274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055626d expref: 15 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.084582:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43b000/0x4b53e3d2c0556274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055626d expref: 15 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.084592:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43b000, rc 0) 00000100:00100000:2.0:1789176534.084684:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865600:12345-0@lo:101:mount.lustre.0 Request processed in 175us (3336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176534.084690:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176534.084734:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176534.084753:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556274 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.084762:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556274 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176534.085905:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1789176534.086599:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176534.093248:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789176534.093302:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1789176534.093317:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1789176534.093329:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1789176534.093342:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1789176534.093354:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1789176534.093366:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1789176534.093378:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1789176534.093390:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1789176534.093402:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1789176534.093414:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1789176534.093426:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1789176534.093440:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1789176534.093453:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1789176534.093465:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1789176534.093477:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1789176534.093489:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1789176534.093501:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1789176534.093512:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1789176534.093524:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1789176534.093537:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1789176534.093549:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1789176534.093561:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1789176534.093574:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1789176534.093586:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1789176534.093598:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1789176534.093612:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1789176534.093625:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1789176534.093636:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1789176534.095599:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1789176534.095628:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1789176534.095648:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1789176534.095815:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1789176534.095867:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1789176534.095889:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1789176534.095981:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1789176534.096011:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1789176534.096392:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1789176534.096418:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1789176534.096440:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1789176534.096462:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1789176534.096492:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1789176534.096514:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1789176534.096534:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1789176534.096574:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1789176534.096583:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1789176534.096768:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176534.096857:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176534.096923:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.097476:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865728 00000100:00100000:1.0:1789176534.097484:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865728 00000100:00100000:1.0:1789176534.097535:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176534.097543:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176534.097698:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865728:12345-0@lo:501:mount.lustre.0 Request processed in 154us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.097706:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789176534.097741:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176534.097782:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176534.097857:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.097888:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05d0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.097952:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865856 00000100:00100000:1.0:1789176534.097957:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865856 00000100:00100000:1.0:1789176534.097988:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176534.097996:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176534.099898:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865856:12345-0@lo:503:mount.lustre.0 Request processed in 1896us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.099909:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789176534.100025:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789176534.100465:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176534.100553:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176534.100599:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.100639:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05d0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.101167:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975865984 00000100:00100000:3.0:1789176534.101174:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975865984 00000100:00100000:3.0:1789176534.101214:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176534.101222:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176534.101768:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975865984:12345-0@lo:502:mount.lustre.0 Request processed in 545us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.101777:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176534.101989:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975865984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789176534.102222:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789176534.102252:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789176534.102264:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789176534.102277:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789176534.102287:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789176534.102308:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789176534.102318:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789176534.102331:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789176534.102342:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789176534.102352:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789176534.102363:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789176534.102375:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789176534.102387:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789176534.102398:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789176534.102409:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789176534.102420:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789176534.102431:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789176534.102442:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789176534.102453:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789176534.102466:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789176534.102478:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789176534.102489:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789176534.102501:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789176534.102514:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789176534.102526:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789176534.102539:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789176534.102553:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789176534.102567:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789176534.102580:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789176534.102593:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789176534.102607:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789176534.102620:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789176534.102632:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789176534.102659:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789176534.102674:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789176534.102687:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789176534.102699:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789176534.102712:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789176534.102737:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789176534.102751:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789176534.102764:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789176534.102777:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789176534.102789:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789176534.102803:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789176534.102873:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975866112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176534.102927:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.102961:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf26583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.103751:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975866112 00000100:00100000:3.0:1789176534.103761:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975866112 00000100:00100000:3.0:1789176534.103804:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176534.103822:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975866112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176534.103969:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975866112:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.103976:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789176534.104086:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975866112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176534.104149:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789176534.104159:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789176534.104909:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176534.104999:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176534.105002:0:23451:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789176534.105008:0:23451:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789176534.105011:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176534.105024:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f0bf7268000) 00000020:00000080:3.0:1789176534.105042:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789176534.105048:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789176534.105126:0:23451:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789176534.105134:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0556282 00000020:00000080:3.0:1789176534.105338:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789176534.105343:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176534.105346:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176534.105348:0:23451:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789176534.105351:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176534.105355:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176534.105356:0:23451:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789176534.105359:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176534.105367:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f0bf72699c0) 00000020:00000080:3.0:1789176534.105377:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789176534.105381:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789176534.105383:0:23451:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789176534.105386:0:23451:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789176534.105391:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789176534.105442:0:23451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac599b800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789176534.105455:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f0bf726b380) 00000020:00000080:3.0:1789176534.105465:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789176534.105512:0:23451:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789176534.105521:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0556297 00000020:00000080:3.0:1789176534.105608:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789176534.105614:0:23451:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789176534.105617:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4b53e3d2c055629e 00080000:01000000:3.0:1789176534.105622:0:23451:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789176534.105625:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05562a5 00010000:00010000:1.0:1789176534.163770:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789176534.165991:0:23451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1789176534.166889:0:23451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789176534.169312:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789176534.169325:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176534.169332:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.169334:0:23451:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789176534.169337:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176534.169343:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.169344:0:23451:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789176534.169347:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789176534.169352:0:23451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:1.0:1789176534.169386:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176534.169401:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f0bfc3499c0) 00000020:00000080:1.0:1789176534.169424:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789176534.169429:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789176534.169510:0:23451:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789176534.169516:0:23451:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789176534.169524:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05562b3 00010000:00080000:1.0:1789176534.169556:0:23451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bf73ef800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176534.176607:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789176534.178239:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176534.178253:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789176534.178290:0:23451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789176534.178309:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05562ba 00000100:00080000:0.0:1789176534.178319:0:23451:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176534.178325:0:23451:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bf73ef800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176534.178357:0:23451:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8720a80 x1876086975866240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176534.178384:0:23451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789176534.178435:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176534.178438:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.178440:0:23451:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789176534.178443:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789176534.178446:0:23451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789176534.178447:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789176534.178449:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789176534.178451:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789176534.178453:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.178454:0:23451:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789176534.178456:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176534.178460:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.178462:0:23451:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789176534.178465:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789176534.178493:0:23451:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789176534.178504:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176534.178514:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.178515:0:23451:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789176534.178518:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789176534.178520:0:23451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789176534.178521:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789176534.178523:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789176534.178524:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789176534.178527:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.178528:0:23451:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789176534.178530:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789176534.178533:0:23451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789176534.178536:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.178538:0:23451:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789176534.178540:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789176534.178544:0:23451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1789176534.178565:0:23451:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789176534.178568:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789176534.178579:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f0bfd60cd40) 00000020:00000080:0.0:1789176534.178590:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789176534.178593:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789176534.178656:0:23451:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789176534.178663:0:23451:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000100:00100000:3.0:1789176534.178758:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975866240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789176534.178818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789176534.178989:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05562c8 00010000:00080000:0.0:1789176534.179020:0:23451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfb8c3000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176534.179287:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1789176534.179562:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789176534.179573:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789176534.179576:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176534.179582:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1789176534.179587:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789176534.179591:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc7154000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176534.179612:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d59c00 x1876086975866368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176534.179636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176534.179645:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176534.179648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176534.179651:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789176534.179698:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975866240 00000100:00100000:1.0:1789176534.179705:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975866240 00000100:00100000:1.0:1789176534.179733:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176534.179740:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975866240:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789176534.179760:0:22719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:1.0:1789176534.179789:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05562cf 00000004:00100000:1.0:1789176534.179801:0:22719:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789176534.179806:0:22719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1789176534.179890:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975866496:0@lo:400:kworker.0 00000100:00100000:1.0:1789176534.179942:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.179979:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975866496 00000100:00100000:1.0:1789176534.179983:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975866496 00000100:00100000:1.0:1789176534.180010:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176534.180016:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975866496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176534.180078:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975866496:12345-0@lo:400:kworker.0 Request processed in 42us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.180085:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789176534.180124:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0be7d58000 x1876086975866496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176534.180137:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975866496:0@lo:400:kworker.0 00000100:00100000:3.0:1789176534.180472:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975866368:0@lo:38:kworker.0 00000100:00100000:3.0:1789176534.180503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.180615:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789176534.180623:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789176534.181061:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975866368 00000100:00100000:0.0:1789176534.181066:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975866368 00000100:00100000:1.0:1789176534.181237:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176534.181243:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1876086975866368:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789176534.181301:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1876086975866368:12345-0@lo:38:kworker.0 Request processed in 57us (796us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789176534.181307:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176534.183387:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176534.183399:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176534.183405:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789176534.183409:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975866368:0@lo:38:kworker.0 00000040:01000000:3.0:1789176534.185264:0:23451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789176534.185462:0:23451:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789176534.187176:0:23451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176534.187371:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789176534.187474:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:0.0:1789176534.188410:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176534.188516:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975866240:12345-0@lo:38:llog_process_th.0 Request processed in 8773us (9694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.188531:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176534.188608:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789176534.188617:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789176534.188625:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789176534.188630:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789176534.188633:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf73ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789176534.188655:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975866240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176534.188787:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176534.188799:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975866624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176534.188877:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.188906:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975866624 00000100:00100000:0.0:1789176534.188911:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975866624 00000100:00100000:0.0:1789176534.188940:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176534.188948:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876086975866624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176534.188971:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789176534.189003:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876086975866624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.189009:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176534.189034:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975866624:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789176534.189484:0:23457:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789176534.189490:0:23457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789176534.190320:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789176534.190332:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789176534.190382:0:23451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789176534.190401:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05562d6 00000100:00080000:3.0:1789176534.190409:0:23451:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789176534.190415:0:23451:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0bfb8c3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176534.190441:0:23451:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776f480 x1876086975866752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176534.190511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975866752:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789176534.190550:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975866752 offset 0 length 520: 4 00000100:00080000:3.0:1789176534.190594:0:23451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789176534.190657:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176534.190660:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176534.190663:0:23451:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789176534.190665:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789176534.190668:0:23451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789176534.190732:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176534.190734:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176534.190736:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789176534.190739:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176534.190740:0:23451:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789176534.190743:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789176534.190748:0:23451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789176534.190751:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176534.190753:0:23451:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789176534.190755:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789176534.190759:0:23451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1789176534.190777:0:23451:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789176534.190780:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176534.190791:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f0bf726cd40) 00000020:00000080:3.0:1789176534.190803:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789176534.190807:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789176534.190901:0:23451:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789176534.190908:0:23451:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789176534.190914:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05562e4 00010000:00080000:3.0:1789176534.190940:0:23451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bc28a9800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1789176534.191213:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789176534.191274:0:23451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789176534.191287:0:23451:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1789176534.191698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176534.191703:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176534.191706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176534.191709:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789176534.193153:0:23451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176534.193347:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789176534.193468:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789176534.193991:0:23459:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789176534.193996:0:23459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789176534.194779:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789176534.194791:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789176534.195157:0:23451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789176534.195257:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05562eb 00000100:00080000:0.0:1789176534.195269:0:23451:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176534.195275:0:23451:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bc28a9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176534.195311:0:23451:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723480 x1876086975866880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176534.195363:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975866880:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789176534.195414:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975866880 offset 0 length 520: 4 00000100:00080000:0.0:1789176534.195467:0:23451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789176534.195571:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176534.195585:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.195587:0:23451:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789176534.195591:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176534.195595:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.195597:0:23451:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789176534.195600:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789176534.195602:0:23451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789176534.195604:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176534.195607:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.195608:0:23451:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789176534.195610:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176534.195612:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.195614:0:23451:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789176534.195618:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789176534.195659:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176534.195663:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176534.195665:0:23451:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789176534.195668:0:23451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1789176534.195937:0:23447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789176534.195969:0:23447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789176534.195992:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556274 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196004:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495800/0x4b53e3d2c055626d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556274 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176534.196012:0:23447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac599b800 from 1 10000000:01000000:2.0:1789176534.196015:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176534.196038:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196046:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196067:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176534.196092:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176534.196132:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.196151:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0421780 going to sleep for 11 seconds 00000100:00100000:2.0:1789176534.196170:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867008 00000100:00100000:2.0:1789176534.196176:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867008 00000100:00100000:2.0:1789176534.196217:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789176534.196224:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+15:23447:x1876086975867008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176534.196234:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176534.196248:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05562f2 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196269:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196278:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196285:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43be00, rc 0) 00000100:00100000:2.0:1789176534.196318:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:23447:x1876086975867008:12345-0@lo:101:mount.lustre.0 Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176534.196324:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789176534.196366:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176534.196380:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176534.196396:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176534.196906:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867136:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789176534.196942:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.196959:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0421780 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.197408:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867136 00000100:00100000:3.0:1789176534.197415:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867136 00000100:00100000:3.0:1789176534.197453:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176534.197461:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:23447:x1876086975867136:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789176534.197477:0:22708:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789176534.197492:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789176534.197496:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789176534.197803:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:23447:x1876086975867136:12345-0@lo:256:mount.lustre.0 Request processed in 343us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.197810:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789176534.197964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176534.197969:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176534.197972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176534.197974:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789176534.198137:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867136:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789176534.199324:0:23447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789176534.199387:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.199398:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176534.199405:0:23447:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b800 from 1 10000000:01000000:0.0:1789176534.199408:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176534.199444:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.199453:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.199472:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176534.199493:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176534.199544:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.199582:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.199635:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867264 00000100:00100000:3.0:1789176534.199650:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867264 00000100:00100000:3.0:1789176534.199756:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176534.199766:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:23447:x1876086975867264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176534.199778:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176534.199792:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556300 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.199814:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.199824:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.199865:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494c00, rc 0) 00000100:00100000:3.0:1789176534.199909:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867264:12345-0@lo:101:mount.lustre.0 Request processed in 144us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.199916:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176534.200009:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176534.200024:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.200033:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176534.202807:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789176534.203151:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176534.203346:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789176534.203369:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789176534.203393:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789176534.203404:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789176534.203415:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789176534.203426:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789176534.203436:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789176534.203447:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789176534.203457:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789176534.203468:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1789176534.203479:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1789176534.203493:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1789176534.203497:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1789176534.203562:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176534.203636:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176534.205080:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867392 00000100:00100000:3.0:1789176534.205093:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867392 00000100:00100000:3.0:1789176534.205155:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789176534.205164:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176534.205298:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867392:12345-0@lo:501:mount.lustre.0 Request processed in 135us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.205306:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176534.205561:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.205585:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176534.205630:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176534.205812:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.205912:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69480 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.212274:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867520 00000100:00100000:3.0:1789176534.212287:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867520 00000100:00100000:3.0:1789176534.212341:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789176534.212349:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176534.213804:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867520:12345-0@lo:503:mount.lustre.0 Request processed in 1448us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.213816:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789176534.214951:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176534.215387:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176534.215471:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.215537:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.215627:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.219590:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867648 00000100:00100000:1.0:1789176534.219605:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867648 00000100:00100000:0.0:1789176534.219776:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789176534.219785:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.219963:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867648:12345-0@lo:502:mount.lustre.0 Request processed in 178us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.219971:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789176534.220092:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176534.220333:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789176534.220361:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1789176534.220373:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1789176534.220383:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1789176534.220394:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1789176534.220404:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1789176534.220415:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1789176534.220425:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1789176534.220436:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789176534.220446:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1789176534.220457:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1789176534.220488:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176534.220526:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.220552:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0421240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.220926:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867776 00000100:00100000:3.0:1789176534.220932:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867776 00000100:00100000:3.0:1789176534.220968:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176534.220975:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176534.221059:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867776:12345-0@lo:502:mount.lustre.0 Request processed in 83us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.221066:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789176534.221160:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176534.221201:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1789176534.221210:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789176534.232286:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176534.232299:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232302:0:23461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789176534.232319:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac599b800 00000020:00000080:1.0:1789176534.232322:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176534.232330:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176534.232332:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232334:0:23461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789176534.232337:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176534.232339:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232340:0:23461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789176534.232344:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac599b800 00000020:00000080:1.0:1789176534.232346:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176534.232428:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176534.232433:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232434:0:23461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789176534.232439:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176534.232441:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232443:0:23461:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176534.232446:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac599b800 00000020:00000080:1.0:1789176534.232447:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176534.232466:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176534.232468:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232475:0:23461:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176534.232480:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176534.232483:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232484:0:23461:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789176534.232487:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac599b800 00000020:00000080:1.0:1789176534.232489:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176534.232515:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176534.232518:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176534.232519:0:23461:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789176534.232522:0:23461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1789176534.232940:0:23447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789176534.232970:0:23447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789176534.233021:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.233033:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176534.233090:0:23447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789176534.233094:0:23447:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0ac599b800 10000000:01000000:0.0:1789176534.233097:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0ac599b800 10000000:01000000:0.0:1789176534.233101:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789176534.233107:0:23447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac599b800 from 1 10000000:01000000:0.0:1789176534.233110:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789176534.233142:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.233150:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.233167:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176534.233190:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176534.233253:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.233296:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176534.233362:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975867904 00000100:00100000:3.0:1789176534.233369:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975867904 00000100:00100000:3.0:1789176534.233418:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789176534.233427:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:23447:x1876086975867904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176534.233440:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176534.233454:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0556315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055630e expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.233476:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0556315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055630e expref: 18 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.233488:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0556315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055630e expref: 18 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176534.233497:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495600, rc 0) 00000100:00100000:3.0:1789176534.233533:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975867904:12345-0@lo:101:mount.lustre.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.233540:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176534.233621:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975867904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176534.233634:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556315 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.233783:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556315 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176534.235216:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1789176534.235470:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176534.235979:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1789176534.236006:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1789176534.236019:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1789176534.236030:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1789176534.236042:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1789176534.236055:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1789176534.236068:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1789176534.236101:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1789176534.236115:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1789176534.236127:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1789176534.236139:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1789176534.236150:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1789176534.236163:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1789176534.236186:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1789176534.236203:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1789176534.236228:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1789176534.236242:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1789176534.236255:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1789176534.236266:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1789176534.236278:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1789176534.236290:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1789176534.236302:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1789176534.236313:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1789176534.236326:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1789176534.236338:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1789176534.236349:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1789176534.236362:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1789176534.236373:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1789176534.236385:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1789176534.236397:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1789176534.236409:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1789176534.236433:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1789176534.236446:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1789176534.236459:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1789176534.236472:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1789176534.236484:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1789176534.236496:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1789176534.236507:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1789176534.236519:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1789176534.236531:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1789176534.236543:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1789176534.236554:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1789176534.236567:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1789176534.236578:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1789176534.236590:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1789176534.236601:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1789176534.236625:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1789176534.236663:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1789176534.237035:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1789176534.237055:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1789176534.237085:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1789176534.237092:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1789176534.237185:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176534.237244:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.237319:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69840 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.237775:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868032 00000100:00100000:1.0:1789176534.237783:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868032 00000100:00100000:1.0:1789176534.237853:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176534.237863:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176534.237991:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868032:12345-0@lo:501:mount.lustre.0 Request processed in 129us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.237999:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789176534.238221:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176534.238257:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176534.238299:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.238357:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69840 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.238396:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868160 00000100:00100000:1.0:1789176534.238401:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868160 00000100:00100000:1.0:1789176534.238462:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789176534.238469:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176534.238552:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868160:12345-0@lo:503:mount.lustre.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.238559:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789176534.238627:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176534.239060:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176534.239139:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.239185:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.239211:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.239227:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868288 00000100:00100000:0.0:1789176534.239232:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868288 00000100:00100000:0.0:1789176534.239263:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176534.239271:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.239352:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868288:12345-0@lo:502:mount.lustre.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.239359:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176534.239402:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176534.239560:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1789176534.239586:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1789176534.239604:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1789176534.239619:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1789176534.239635:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1789176534.239650:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1789176534.239666:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1789176534.239681:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1789176534.239696:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1789176534.239723:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1789176534.239738:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1789176534.239751:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1789176534.239762:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1789176534.239774:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1789176534.239788:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1789176534.239800:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1789176534.239812:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1789176534.239824:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1789176534.239858:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1789176534.239875:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1789176534.239889:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1789176534.239903:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1789176534.239914:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1789176534.239925:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1789176534.239938:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1789176534.239965:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1789176534.239980:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1789176534.239993:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1789176534.240006:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1789176534.240020:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1789176534.240031:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1789176534.240043:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1789176534.240067:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1789176534.240268:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1789176534.240289:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1789176534.240305:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1789176534.240325:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1789176534.240341:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1789176534.240356:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1789176534.240369:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1789176534.240383:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1789176534.240410:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1789176534.240426:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1789176534.240439:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1789176534.240454:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1789176534.240468:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1789176534.240481:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1789176534.240492:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1789176534.240531:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.240580:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.240612:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.240634:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868416 00000100:00100000:0.0:1789176534.240639:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868416 00000100:00100000:0.0:1789176534.240669:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176534.240676:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.240761:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868416:12345-0@lo:502:mount.lustre.0 Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.240768:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176534.240816:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176534.240966:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1789176534.240986:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1789176534.241010:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.241043:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.241061:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.241086:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868544 00000100:00100000:0.0:1789176534.241090:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868544 00000100:00100000:0.0:1789176534.241115:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176534.241121:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176534.241199:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868544:12345-0@lo:502:mount.lustre.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.241206:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176534.241245:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176534.241287:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1789176534.241294:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789176534.241750:0:23463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789176534.241765:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f0bfd6099c0) 00000020:00000080:0.0:1789176534.241785:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789176534.241878:0:23463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac599b800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789176534.241882:0:23463:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac599b800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789176534.241884:0:23463:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac599b800 3 00010000:00080000:0.0:1789176534.241913:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfd315800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176534.245157:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789176534.245375:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789176534.245434:0:23463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789176534.245448:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4b53e3d2c0556323 00000100:00080000:0.0:1789176534.245458:0:23463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176534.245464:0:23463:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0bfd315800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176534.245500:0:23463:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8722d80 x1876086975868672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176534.245551:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975868672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176534.245623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.247859:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868672 00000100:00100000:0.0:1789176534.247872:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868672 00000100:00100000:0.0:1789176534.247913:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176534.247921:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975868672:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789176534.247948:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:0.0:1789176534.247984:0:22714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4b53e3d2c055632a 00000004:00100000:0.0:1789176534.247997:0:22714:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789176534.248027:0:22714:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd310000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176534.248108:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876086975868672:12345-0@lo:38:llog_process_th.0 Request processed in 186us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.248117:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789176534.248161:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0ac8722d80 x1876086975868672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176534.248173:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176534.248181:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789176534.248188:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789176534.248192:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789176534.248194:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789176534.248200:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975868672:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789176534.248222:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789176534.248246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176534.248250:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176534.248261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176534.248264:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789176534.251914:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1789176534.252227:0:23447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789176534.252258:0:23447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789176534.252281:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556315 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176534.252294:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c055630e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556315 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789176534.252343:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789176534.252345:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176534.252347:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176534.252348:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176534.252349:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176534.252351:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176534.252353:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176534.252355:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176534.252356:0:23447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176534.252360:0:23447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789176534.252363:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176534.252364:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176534.252366:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176534.252367:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176534.252368:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176534.252370:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176534.252371:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176534.252372:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176534.252373:0:23447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176534.252397:0:23447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789176534.252417:0:23447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789176534.252483:0:23447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176534.252517:0:23447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.252545:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868800 00000100:00100000:0.0:1789176534.252551:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868800 00000100:00100000:0.0:1789176534.252591:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176534.252600:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789176534.252626:0:22709:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789176534.252645:0:22709:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789176534.266310:0:22694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789176534.266790:0:22709:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789176534.266855:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789176534.269120:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:23447:x1876086975868800:12345-0@lo:253:mount.lustre.0 Request processed in 16514us (16630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.269133:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176534.269208:0:23447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:23447:1876086975868800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789176534.269222:0:23447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789176534.269225:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789176534.269227:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176534.269228:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176534.269230:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176534.269231:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176534.269232:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176534.269234:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176534.269235:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176534.269237:0:23447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789176534.269279:0:23447:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789176534.273111:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789176534.273119:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789176534.273142:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.273172:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.273181:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.273189:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.273226:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.273242:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 17 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176534.273257:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975868928:0@lo:104: 00000100:00100000:1.0:1789176534.273312:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789176534.273355:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.273364:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 17 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176534.273372:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975869056:0@lo:104: 00000100:00100000:1.0:1789176534.273393:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.276800:0:22730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.276874:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975868928 00000100:00100000:1.0:1789176534.276883:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975868928 00000100:00100000:1.0:1789176534.276916:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869056 00000100:00100000:1.0:1789176534.276925:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869056 00000100:00100000:1.0:1789176534.276943:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176534.276951:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:22730:x1876086975868928:12345-0@lo:104: 00010000:00010000:1.0:1789176534.276969:0:22698:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277052:0:22698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176534.277058:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:22730:x1876086975868928:12345-0@lo:104: Request processed in 108us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.277066:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176534.277093:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176534.277100:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975869056:12345-0@lo:104: 00010000:00010000:1.0:1789176534.277107:0:22698:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277138:0:22698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789176534.277143:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975869056:12345-0@lo:104: Request processed in 45us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.277149:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789176534.277169:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789176534.277175:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277181:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176534.277186:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277194:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176534.277212:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176534.277217:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176534.277252:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277259:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176534.277277:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277284:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b200/0x4b53e3d2c05562f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05562f9 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277298:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176534.277302:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277307:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176534.277310:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277317:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176534.277323:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176534.277328:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176534.277349:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277355:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176534.277363:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277369:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055622e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556235 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.277385:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176534.277387:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176534.277389:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176534.277398:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176534.277420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975869184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176534.277458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.277498:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176534.277505:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975869312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176534.277524:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176534.277566:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869184 00000100:00100000:1.0:1789176534.277570:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869184 00010000:00010000:1.0:1789176534.277589:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 18 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176534.277610:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869312 00000100:00100000:1.0:1789176534.277612:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869312 00010000:00010000:1.0:1789176534.277624:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 19 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176534.277636:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789176534.277856:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975868928:0@lo:104: 00000100:00100000:2.0:1789176534.277876:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975869056:0@lo:104: 00010000:00010000:2.0:1789176534.277895:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176534.278380:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:3642:x1876086975869184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176534.278403:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176534.278409:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 19 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278421:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 19 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278435:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05562f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05562f2 expref: 19 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278447:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176534.278494:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3642:x1876086975869184:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.278501:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176534.278515:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176534.278521:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:3642:x1876086975869312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176534.278527:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176534.278531:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 17 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278539:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 17 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278548:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c0556235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055622e expref: 17 pid: 22707 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278558:0:22700:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278565:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789176534.278585:0:22700:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011510252s 00010000:00010000:1.0:1789176534.278590:0:22700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278597:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278604:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278611:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278616:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176534.278620:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278628:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278656:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.278666:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176534.279873:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975869184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176534.280085:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:3642:x1876086975869312:12345-0@lo:103:ldlm_bl.0 Request processed in 1562us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.280095:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789176534.280143:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.280167:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176534.280174:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556331 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176534.285869:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975869312:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1789176534.290395:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789176534.290536:0:23472:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789176534.290540:0:23472:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789176534.290614:0:23473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789176534.290778:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789176534.291296:0:23474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23474:1876086975869440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789176534.291363:0:23474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.291395:0:23474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953300 going to sleep for 11 seconds 00000040:01000000:1.0:1789176534.291526:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789176534.291562:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789176534.292102:0:23447:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789176534.292110:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789176534.292147:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176534.293224:0:23447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789176534.293767:0:23447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789176534.293799:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789176534.293916:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789176534.294474:0:23447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1789176534.294958:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869440 00000100:00100000:3.0:1789176534.294967:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869440 00000100:00100000:3.0:1789176534.295013:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176534.295022:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23474:x1876086975869440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789176534.295149:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23474:x1876086975869440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176534.295157:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789176534.295229:0:23474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23474:1876086975869440:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789176534.295262:0:23474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789176534.295300:0:23474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23474:1876086975869568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789176534.295338:0:23474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.295357:0:23474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.295586:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869568 00000100:00100000:0.0:1789176534.295591:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869568 00000100:00100000:0.0:1789176534.295631:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789176534.295638:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23474:x1876086975869568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789176534.295808:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23474:x1876086975869568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 171us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.295826:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176534.296871:0:23474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23474:1876086975869568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789176534.296944:0:23474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23474:1876086975869696:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789176534.296986:0:23474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.297004:0:23474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953300 going to sleep for 11 seconds 00000100:00100000:1.0:1789176534.297429:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869696 00000100:00100000:1.0:1789176534.297436:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869696 00000100:00100000:1.0:1789176534.297608:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176534.297618:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23474:x1876086975869696:12345-0@lo:900:lod0001_rec0000.0 00000040:00080000:0.0:1789176534.298132:0:23473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176534.303499:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789176534.303586:0:23473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789176534.303868:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23474:x1876086975869696:12345-0@lo:900:lod0001_rec0000.0 Request processed in 6247us (6877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176534.303881:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789176534.304777:0:23474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0beb56e300 x1876086975869696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176550 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176534.304792:0:23474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23474:1876086975869696:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789176534.305226:0:23474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23474:1876086975869824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789176534.305279:0:23474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176534.305308:0:23474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc35296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176534.305375:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869824 00000100:00100000:0.0:1789176534.305382:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869824 00000100:00100000:0.0:1789176534.305427:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176534.305435:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23474:x1876086975869824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789176534.305514:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23474:x1876086975869824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176534.305522:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176534.305584:0:23474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23474:1876086975869824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789176534.305628:0:23474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176534.307723:0:23474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789176534.307809:0:23474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789176534.307814:0:23474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1789176534.309451:0:23447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789176534.314412:0:23447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789176534.314456:0:23447:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc1a741c4f988 00100000:10000000:1.0:1789176534.314465:0:23447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789176534.321993:0:23447:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789176534.322028:0:23447:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789176534.322049:0:23447:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789176534.322082:0:23447:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:1.0:1789176534.324776:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000020:00000004:1.0:1789176534.325187:0:23447:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176534.325475:0:23447:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176534.709917:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176535.345971:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000040:00080000:2.0:1789176535.346633:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789176535.730116:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789176536.306133:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176536.306141:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac599b800 from 12 10000000:01000000:2.0:1789176536.306146:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176536.306195:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.306206:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.306217:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176536.306241:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975869952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176536.306307:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176536.306349:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176536.306453:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975869952 00000100:00100000:1.0:1789176536.306461:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975869952 00000100:00100000:1.0:1789176536.306511:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789176536.306521:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:22711:x1876086975869952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176536.306534:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176536.306548:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556338 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176536.306569:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176536.306580:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176536.306588:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2800, rc 0) 00000100:00100000:1.0:1789176536.306634:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975869952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176536.306648:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789176536.306768:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975869952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176536.306794:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.306805:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176536.306876:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975870080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789176536.306910:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176536.306934:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176536.306984:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870080 00000100:00100000:0.0:1789176536.306989:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870080 00000100:00100000:0.0:1789176536.307029:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789176536.307036:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975870080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789176536.307049:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789176536.307075:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789176536.307078:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1789176536.307164:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975870080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176536.307171:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789176536.307299:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975870080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789176536.307338:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176536.307349:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.307357:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176536.307365:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176536.307367:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bfbff9000 from 12 10000000:01000000:2.0:1789176536.307369:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176536.307385:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.307392:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.307399:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176536.307412:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975870208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176536.307436:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176536.307465:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176536.307598:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870208 00000100:00100000:1.0:1789176536.307603:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870208 00000100:00100000:1.0:1789176536.307642:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789176536.307649:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975870208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176536.307657:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176536.307668:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556346 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176536.307685:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176536.307694:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176536.307702:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2200, rc 0) 00000100:00100000:1.0:1789176536.307731:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975870208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176536.307736:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789176536.308005:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975870208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176536.308018:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.308026:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176536.308076:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975870336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789176536.308114:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176536.308142:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176536.308240:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870336 00000100:00100000:1.0:1789176536.308244:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870336 00000100:00100000:1.0:1789176536.308276:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789176536.308282:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975870336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789176536.308293:0:22707:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176536.308305:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176536.308308:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789176536.308381:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975870336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176536.308398:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789176536.308885:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975870336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789176536.308924:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176536.308931:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176536.308939:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176536.370309:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000040:00080000:2.0:1789176536.370485:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789176536.759641:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176537.423871:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00010000:00010000:0.0:1789176537.785994:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176538.482504:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000001:02000400:2.0:1789176538.574681:0:23718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789176538.807011:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176539.489739:0:23770:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176539.492826:0:23770:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176539.509814:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 0 seconds 00000100:00080000:0.0:1789176539.697978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789176539.697995:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789176539.697999:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176539.698020:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc7154000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176539.698056:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723b80 x1876086975870592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176539.698073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176539.698077:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176539.698079:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176539.698083:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176539.698116:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176539.698119:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176539.698122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176539.698124:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789176539.698142:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975870848:0@lo:400:kworker.0 00000100:00100000:1.0:1789176539.698147:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975870464:0@lo:400:kworker.0 00000100:00100000:2.0:1789176539.698249:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975870720:0@lo:400:kworker.0 00000100:00100000:0.0:1789176539.698706:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176539.698775:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176539.698781:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975870976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176539.698802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176539.701171:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176539.701171:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176539.703680:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870848 00000100:00100000:3.0:1789176539.703696:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870848 00000100:00100000:3.0:1789176539.703757:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870976 00000100:00100000:3.0:1789176539.703761:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870976 00000100:00100000:3.0:1789176539.703781:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176539.703790:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1876086975870848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176539.703893:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1876086975870848:12345-0@lo:400:kworker.0 Request processed in 104us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176539.703901:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176539.703920:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176539.703927:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975870976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176539.703951:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789176539.704024:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975871104:0@lo:400:kworker.0 00000100:00100000:0.0:1789176539.704073:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176539.704086:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975870592:0@lo:38:kworker.0 00000100:00100000:0.0:1789176539.704112:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870720 00000100:00100000:0.0:1789176539.704118:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870720 00000100:00100000:1.0:1789176539.704129:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176539.704149:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871104 00000100:00100000:0.0:1789176539.704152:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871104 00000100:00100000:0.0:1789176539.704169:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176539.704177:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975870720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176539.704182:0:22715:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789176539.704192:0:22715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789176539.704215:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870464 00000100:00100000:1.0:1789176539.704220:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870464 00000100:00100000:0.0:1789176539.704229:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975870720:12345-0@lo:400:kworker.0 Request processed in 51us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176539.704238:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176539.704258:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176539.704259:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176539.704271:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3644:x1876086975870464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176539.704272:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975871104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176539.704325:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3644:x1876086975870464:12345-0@lo:400:kworker.0 Request processed in 57us (3161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176539.704331:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176539.704543:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975871104:12345-0@lo:400:kworker.0 Request processed in 274us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176539.704550:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176539.704573:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975870592 00000100:00100000:0.0:1789176539.704577:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975870592 00000100:00100000:0.0:1789176539.704591:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176539.704596:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975870592:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789176539.704618:0:22720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:0.0:1789176539.704652:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0556354 00000004:00100000:0.0:1789176539.704666:0:22720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789176539.704672:0:22720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:0.0:1789176539.704759:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac8723100 x1876086975871104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176539.704773:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975871104:0@lo:400:kworker.0 00000100:00100000:0.0:1789176539.704786:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975870464:0@lo:400:kworker.0 00010000:00080000:0.0:1789176539.704823:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac8720000 x1876086975870720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176539.705203:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975870976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1276us (6398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176539.705211:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176539.705676:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975870976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176539.705693:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975870848:0@lo:400:kworker.0 00000100:00100000:0.0:1789176539.706187:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975870720:0@lo:400:kworker.0 00000100:00080000:0.0:1789176539.715536:0:22720:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176539.715653:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975870592:12345-0@lo:38:kworker.0 Request processed in 11053us (11522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176539.715663:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789176539.716186:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789176539.716197:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789176539.716203:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789176539.716206:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7154000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789176539.716244:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000afd290af): req@ffff9f0ac776ea00 x1876086975863680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176539.716261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975870592:0@lo:38:kworker.0 00000100:00100000:1.0:1789176539.716447:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975871232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176539.716493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176539.718351:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871232 00000100:00100000:1.0:1789176539.718364:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871232 00000100:00100000:1.0:1789176539.718453:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176539.718463:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876086975871232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176539.718499:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176539.718632:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876086975871232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176539.718640:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176539.718700:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975871232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176539.722158:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176539.722207:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd06e1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789176539.722317:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975863680 00000100:00100000:1.0:1789176539.722327:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975863680 00000100:00100000:1.0:1789176539.722386:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176539.722395:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22756:x1876086975863680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176539.722492:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22756:x1876086975863680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176539.722500:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176539.723064:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1876086975863680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789176539.723110:0:22756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789176539.726211:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1876086975871360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789176539.726298:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176539.726334:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176539.726367:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871360 00000100:00100000:1.0:1789176539.726375:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871360 00000100:00100000:1.0:1789176539.726430:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176539.726440:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1876086975871360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176539.726586:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1876086975871360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 147us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176539.726594:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176539.726674:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1876086975871360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789176539.726750:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1876086975871488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789176539.726779:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176539.726797:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658540 going to sleep for 11 seconds 00000100:00100000:2.0:1789176539.726811:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871488 00000100:00100000:2.0:1789176539.726815:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871488 00000100:00100000:2.0:1789176539.726906:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176539.726915:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22756:x1876086975871488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789176539.727003:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22756:x1876086975871488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176539.727010:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176539.727046:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1876086975871488:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789176539.727088:0:22756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176539.729719:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789176539.729806:0:22756:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1789176539.729812:0:22756:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789176539.828410:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176540.403729:0:23821:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176540.404154:0:23821:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176540.851011:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789176541.411567:0:23869:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7be2ada0 20000000:00000080:0.0:1789176541.411585:0:23869:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bd0d2dc00 uarg=0000000000000000 20000000:01000000:0.0:1789176541.411627:0:23869:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789176541.411634:0:23869:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789176541.411638:0:23869:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789176541.412101:0:23870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789176541.412253:0:23869:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789176541.435608:0:23869:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789176541.435882:0:23869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.435901:0:23869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.435908:0:23869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.435916:0:23869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.435961:0:23869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.435978:0:23869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 17 pid: 22707 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176541.435992:0:23869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876086975871616:0@lo:104: 00000100:00100000:2.0:1789176541.436060:0:23869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176541.436120:0:23869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176541.436126:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871616 00000100:00100000:3.0:1789176541.436133:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871616 00010000:00010000:2.0:1789176541.436139:0:23869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 17 pid: 22708 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176541.436147:0:23869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876086975871744:0@lo:104: 00000100:00100000:2.0:1789176541.436168:0:23869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176541.436177:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871744 00000100:00100000:2.0:1789176541.436179:0:23869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176541.436180:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871744 00000100:00100000:3.0:1789176541.436194:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176541.436203:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:23869:x1876086975871616:12345-0@lo:104: 00010000:00010000:3.0:1789176541.436216:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436284:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176541.436290:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:23869:x1876086975871616:12345-0@lo:104: Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176541.436296:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789176541.436298:0:23869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876086975871616:0@lo:104: 00000100:00100000:3.0:1789176541.436312:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176541.436319:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:23869:x1876086975871744:12345-0@lo:104: 00010000:00010000:3.0:1789176541.436327:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436350:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176541.436357:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436364:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789176541.436365:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176541.436368:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176541.436369:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:23869:x1876086975871744:12345-0@lo:104: Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176541.436375:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789176541.436378:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176541.436385:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176541.436391:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176541.436426:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436432:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176541.436450:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436457:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d800/0x4b53e3d2c0556300 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556307 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436468:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176541.436472:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436477:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43a800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176541.436480:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436493:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176541.436499:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176541.436504:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176541.436527:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436533:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176541.436539:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436546:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c05561fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556204 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436558:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176541.436559:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176541.436561:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176541.436571:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975871872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176541.436599:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176541.436632:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176541.436637:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975872000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789176541.436643:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975871872 00000100:00100000:3.0:1789176541.436647:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975871872 00000100:00100000:1.0:1789176541.436657:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176541.436663:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 18 pid: 22707 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176541.436681:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872000 00000100:00100000:3.0:1789176541.436684:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872000 00000100:00100000:1.0:1789176541.436685:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176541.436692:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:3642:x1876086975871872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176541.436693:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 19 pid: 22708 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176541.436702:0:22700:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789176541.436702:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789176541.436708:0:22700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789176541.436711:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 19 pid: 22707 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176541.436721:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 19 pid: 22707 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176541.436722:0:22699:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789176541.436727:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176541.436733:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:3642:x1876086975872000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176541.436734:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0556307 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0556300 expref: 19 pid: 22707 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436746:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176541.436746:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176541.436750:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 18 pid: 22708 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436758:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 18 pid: 22708 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436770:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176541.436770:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3642:x1876086975871872:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176541.436777:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789176541.436778:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436789:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436795:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176541.436798:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975871872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176541.436803:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436809:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436814:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176541.436818:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436825:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.436868:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495c00/0x4b53e3d2c0556204 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05561fd expref: 17 pid: 22708 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176541.436877:0:23869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876086975871744:0@lo:104: 00010000:00010000:3.0:1789176541.436880:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176541.436889:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176541.436891:0:23869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.436899:0:23869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.436905:0:23869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176541.436911:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c055635b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176541.436921:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:3642:x1876086975872000:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176541.436928:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789176541.437655:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176541.438231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975872000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176541.883348:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789176542.770908:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789176542.770916:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b800 from 13 10000000:01000000:3.0:1789176542.770921:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176542.770965:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176542.770976:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176542.770988:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176542.771023:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176542.771092:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176542.771138:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176542.771212:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872128 00000100:00100000:0.0:1789176542.771219:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872128 00000100:00100000:0.0:1789176542.771269:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176542.771278:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+16:22711:x1876086975872128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176542.771291:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176542.771304:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556362 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.771340:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.771351:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.771361:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9de00, rc 0) 00000100:00100000:0.0:1789176542.771409:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975872128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176542.771416:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789176542.771565:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176542.771579:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176542.771589:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176542.771668:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176542.771696:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176542.771874:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872256 00000100:00100000:0.0:1789176542.771879:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872256 00000100:00100000:0.0:1789176542.771913:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789176542.771920:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975872256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176542.772024:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975872256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176542.772031:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789176542.772148:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176542.772161:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176542.772189:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176542.772226:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176542.772238:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176542.772286:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872384 00000100:00100000:0.0:1789176542.772291:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872384 00000100:00100000:0.0:1789176542.772322:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789176542.772328:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975872384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176542.772404:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975872384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176542.772412:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789176542.772451:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789176542.773303:0:23937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789176542.773608:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789176542.773631:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176542.773640:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176542.773660:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176542.773680:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176542.773683:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfbff9000 from 13 10000000:01000000:2.0:1789176542.773685:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176542.773712:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176542.773719:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176542.773907:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176542.773927:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176542.773974:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176542.774003:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176542.774145:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872512 00000100:00100000:0.0:1789176542.774152:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872512 00000100:00100000:0.0:1789176542.774191:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789176542.774198:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+17:22711:x1876086975872512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176542.774208:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176542.774220:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556370 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.774240:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.774250:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.774257:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9da00, rc 0) 00000100:00100000:0.0:1789176542.774287:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975872512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176542.774292:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789176542.774382:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176542.774394:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176542.774402:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176542.774452:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176542.774474:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176542.774998:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789176542.775917:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872640 00000100:00100000:3.0:1789176542.775927:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872640 00000100:00100000:3.0:1789176542.776007:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789176542.776024:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975872640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176542.776166:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975872640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176542.776173:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789176542.776256:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176542.776297:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176542.776347:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176542.776811:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176542.777038:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872768 00000100:00100000:0.0:1789176542.777045:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872768 00000100:00100000:0.0:1789176542.777075:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789176542.777082:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975872768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176542.777177:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:22711:x1876086975872768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176542.777184:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789176542.777300:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975872768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789176542.778313:0:23938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789176542.778468:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789176542.778489:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176542.778498:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176542.778509:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176542.899573:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176543.474812:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789176543.924020:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176544.819878:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176534/real 1789176534] req@ffff9f0ac8723480 x1876086975866880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176544 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176544.819910:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8723480 x1876086975866880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176544 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176544.819921:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176534/real 1789176534] req@ffff9f0ac776f480 x1876086975866752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176544 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176544.819934:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac776f480 x1876086975866752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176544 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176544.819953:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176544.819963:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176544.819967:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975866880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789176544.819973:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176544.819977:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176544.819981:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975866752:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789176544.821345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176544.821353:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176544.821356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176544.821359:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176544.821392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176544.821396:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789176544.821399:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176544.821406:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 655 00000100:00080000:2.0:1789176544.821413:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789176544.821420:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0bfb8c3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176544.821443:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0beb56e680 x1876086975873408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176544.821461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176544.821464:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789176544.821466:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176544.821470:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 655 00000100:00080000:2.0:1789176544.821473:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789176544.821477:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bc28a9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176544.821488:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0beb56d500 x1876086975873536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176544.821543:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975873408:0@lo:8:kworker.0 00000400:00000100:2.0:1789176544.821602:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975873408 offset 0 length 520: 4 00000100:00100000:2.0:1789176544.821641:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975873536:0@lo:8:kworker.0 00000400:00000100:2.0:1789176544.821661:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975873536 offset 0 length 520: 4 00000100:00100000:1.0:1789176544.822594:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975873152:0@lo:400:kworker.0 00000100:00100000:1.0:1789176544.822642:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176544.822680:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176544.822687:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975873280:0@lo:400:kworker.0 00000100:00100000:1.0:1789176544.822712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176544.822750:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975873280 00000100:00100000:1.0:1789176544.822758:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975873280 00000100:00100000:1.0:1789176544.822808:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176544.822818:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975873280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176544.823096:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975873280:12345-0@lo:400:kworker.0 Request processed in 278us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176544.823103:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176544.824193:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975873152 00000100:00100000:2.0:1789176544.824206:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975873152 00000100:00100000:2.0:1789176544.824258:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176544.824268:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975873152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176544.824325:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975873152:12345-0@lo:400:kworker.0 Request processed in 60us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176544.824332:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176544.824594:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975873024:0@lo:400:kworker.0 00000100:00100000:3.0:1789176544.824633:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176544.824670:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975873792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176544.824694:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176544.824715:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789176544.824722:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975872896:0@lo:400:kworker.0 00000100:00100000:3.0:1789176544.824748:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176544.824775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975873664:0@lo:400:kworker.0 00000100:00100000:3.0:1789176544.824801:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176544.824860:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975872896 00000100:00100000:3.0:1789176544.824865:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975872896 00000100:00100000:3.0:1789176544.824895:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789176544.824902:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3645:x1876086975872896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176544.824938:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3645:x1876086975872896:12345-0@lo:400:kworker.0 Request processed in 37us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176544.824945:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789176544.824976:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975873664 00000100:00100000:3.0:1789176544.824980:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975873664 00000100:00100000:3.0:1789176544.825015:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176544.825022:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975873664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176544.825050:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975873664:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176544.825056:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176544.825089:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975872896:0@lo:400:kworker.0 00010000:00080000:3.0:1789176544.825102:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0beb56f800 x1876086975873664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176544.825113:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975873664:0@lo:400:kworker.0 00000100:00100000:0.0:1789176544.828327:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176544.828353:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975873920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176544.828422:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176544.828504:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975873024 00000100:00100000:2.0:1789176544.828513:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975873024 00000100:00100000:2.0:1789176544.828548:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975873792 00000100:00100000:2.0:1789176544.828551:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975873792 00000100:00100000:2.0:1789176544.828563:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975873920 00000100:00100000:2.0:1789176544.828565:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975873920 00000100:00100000:2.0:1789176544.828578:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176544.828587:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975873024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176544.828696:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975873024:12345-0@lo:400:kworker.0 Request processed in 110us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176544.828705:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176544.828724:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176544.828730:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975873792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176544.828755:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789176544.828800:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975873792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176544.828806:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176544.828819:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176544.828826:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975873920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176544.828866:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176544.828903:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975873920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176544.828909:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176544.828950:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975873920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176544.830153:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975873280:0@lo:400:kworker.0 00010000:00080000:1.0:1789176544.830172:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0beb56c000 x1876086975873152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176544.830183:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975873152:0@lo:400:kworker.0 00000100:00100000:0.0:1789176544.830437:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975873024:0@lo:400:kworker.0 00000100:00100000:2.0:1789176544.830518:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975873792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789176544.947025:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176545.842181:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176530/real 1789176530] req@ffff9f0be7d59500 x1876086975864704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176545.842214:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0be7d59500 x1876086975864704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176545.842225:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176530/real 1789176530] req@ffff9f0be7d5a680 x1876086975864832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176545.842236:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0be7d5a680 x1876086975864832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789176545.842257:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176545.842279:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789176545.842283:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864704:0@lo:8:kworker.0 00000100:00080000:2.0:1789176545.842289:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176545.842308:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789176545.842311:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975864832:0@lo:8:kworker.0 00000100:00080000:1.0:1789176545.842695:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176545.842700:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789176545.842704:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176545.842709:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1789176545.842715:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789176545.842722:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bfb8c1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176545.842742:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d59c00 x1876086975874304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176545.842754:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176545.842757:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789176545.842759:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176545.842763:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1789176545.842765:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789176545.842769:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0ac85e7000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176545.842780:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d5a680 x1876086975874432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176545.842800:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176545.842804:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176545.842807:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176545.842815:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789176545.842865:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975874688:0@lo:400:kworker.0 00000100:00100000:1.0:1789176545.842924:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176545.842952:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789176545.842958:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975874048:0@lo:400:kworker.0 00000100:00100000:1.0:1789176545.842982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176545.843014:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975874816:0@lo:400:kworker.0 00000100:00100000:1.0:1789176545.843040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176545.843393:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975874176:0@lo:400:kworker.0 00000100:00100000:0.0:1789176545.843426:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176545.843455:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176545.843461:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975874560:0@lo:400:kworker.0 00000100:00100000:0.0:1789176545.843491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176545.843680:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975874688 00000100:00100000:2.0:1789176545.843688:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975874688 00000100:00100000:2.0:1789176545.843727:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975874176 00000100:00100000:2.0:1789176545.843730:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975874176 00000100:00100000:2.0:1789176545.843744:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176545.843752:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975874688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176545.843804:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975874688:12345-0@lo:400:kworker.0 Request processed in 52us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176545.843812:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176545.843827:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789176545.843850:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975874176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176545.843883:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975874176:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176545.843888:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789176545.843905:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975874048 00000100:00100000:2.0:1789176545.843908:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975874048 00000100:00100000:2.0:1789176545.843929:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789176545.843934:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3642:x1876086975874048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176545.843964:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:3642:x1876086975874048:12345-0@lo:400:kworker.0 Request processed in 29us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176545.843969:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789176545.844423:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975874816 00000100:00100000:0.0:1789176545.844430:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975874816 00000100:00100000:0.0:1789176545.844458:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975874560 00000100:00100000:0.0:1789176545.844461:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975874560 00000100:00100000:0.0:1789176545.844479:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176545.844485:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975874816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176545.844520:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975874816:12345-0@lo:400:kworker.0 Request processed in 35us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176545.844526:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176545.844540:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789176545.844545:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975874560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176545.844570:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975874560:12345-0@lo:400:kworker.0 Request processed in 24us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176545.845192:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975874048:0@lo:400:kworker.0 00010000:00080000:2.0:1789176545.845209:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac8519500 x1876086975874816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176545.845233:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975874816:0@lo:400:kworker.0 00000100:00100000:2.0:1789176545.845245:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975874688:0@lo:400:kworker.0 00000100:00100000:2.0:1789176545.845359:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975874304:0@lo:8:kworker.0 00000400:00000100:2.0:1789176545.845402:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975874304 offset 0 length 520: 4 00000100:00100000:2.0:1789176545.845428:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975874432:0@lo:8:kworker.0 00000400:00000100:2.0:1789176545.845446:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975874432 offset 0 length 520: 4 00000100:00100000:0.0:1789176545.845805:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789176545.845860:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0be7d59500 x1876086975874560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176545.845872:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975874560:0@lo:400:kworker.0 00000100:00100000:0.0:1789176545.845883:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975874176:0@lo:400:kworker.0 00000001:00100000:0.0:1789176545.850962:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789176545.969957:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176546.623254:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789176546.996530:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789176547.435633:0:24218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789176547.435637:0:24218:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789176547.435638:0:24218:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789176547.435751:0:24218:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0ac7f8b000 00000020:01000004:1.0:1789176547.435774:0:24218:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789176547.436022:0:24218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789176547.436038:0:24218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f0bfc34cd40) 00000020:00000080:1.0:1789176547.436056:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789176547.485641:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789176547.488203:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789176547.488875:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789176547.489097:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789176547.489365:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789176547.489607:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789176547.489963:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1789176547.491449:0:24218:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789176547.491685:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789176547.491699:0:24218:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789176547.491712:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b53e3d2c0556385 00000020:01000004:0.0:1789176547.491718:0:24218:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789176547.491740:0:24218:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789176547.491744:0:24218:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789176547.491749:0:24218:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789176547.491754:0:24218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789176547.491765:0:24218:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f0bfd608000) 00000020:00000080:0.0:1789176547.492034:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789176547.493100:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789176547.493278:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789176547.493284:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789176547.498420:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176547.498432:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789176547.498988:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789176547.498995:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789176547.500501:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176547.500742:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789176547.500748:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789176547.505058:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789176547.505198:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789176547.522379:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176547.522692:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789176547.522699:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789176547.524398:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789176547.524410:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789176547.525360:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789176547.525367:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789176547.528139:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176547.528355:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789176547.528361:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789176547.538923:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789176547.538946:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789176547.588475:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176547.588683:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789176547.588689:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789176547.591699:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789176547.591715:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789176547.592431:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789176547.592460:0:24218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789176547.592466:0:24218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789176547.638233:0:24218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789176547.638271:0:24218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789176547.638276:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789176547.638278:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789176547.638279:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176547.638280:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176547.638282:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176547.638283:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176547.638284:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176547.638286:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176547.638287:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176547.638291:0:24218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789176547.638293:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789176547.638294:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789176547.638296:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176547.638302:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176547.638303:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176547.638304:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176547.638305:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176547.638306:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176547.638307:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176547.638334:0:24218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789176547.638354:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975874944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789176547.638433:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176547.638824:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf33c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789176547.640293:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975874944 00000100:00100000:3.0:1789176547.640306:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975874944 00000100:00100000:3.0:1789176547.640371:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789176547.640382:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:24218:x1876086975874944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789176547.640434:0:22708:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789176547.640438:0:22708:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789176547.640442:0:22708:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789176547.640791:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:24218:x1876086975874944:12345-0@lo:253:mount.lustre.0 Request processed in 409us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176547.640800:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789176547.640984:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975874944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176547.640997:0:24218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789176547.641001:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176547.641002:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789176547.641004:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176547.641004:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176547.641005:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176547.641007:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176547.641008:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176547.641010:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176547.641011:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176547.641033:0:24218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac7f8b000 from lustre-OST0000 10000000:01000000:1.0:1789176547.641064:0:24218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789176547.641066:0:24218:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789176547.641074:0:24218:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0bd16fcd40 local copy 00010000:00010000:1.0:1789176547.641083:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176547.641176:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176547.641212:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176547.641251:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf33c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176547.641304:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875072 00000100:00100000:2.0:1789176547.641309:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875072 00000100:00100000:2.0:1789176547.641357:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789176547.641365:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:24218:x1876086975875072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176547.641436:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:24218:x1876086975875072:12345-0@lo:501:mount.lustre.0 Request processed in 73us (223us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176547.641443:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789176547.641547:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875072:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789176547.641560:0:24218:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789176547.641584:0:24218:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789176547.641590:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176547.641599:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176547.641643:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0ac7f8b000 10000000:01000000:1.0:1789176547.641648:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789176547.641652:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789176547.641655:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176547.641658:0:24218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789176547.641661:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789176547.641682:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176547.641690:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176547.641699:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176547.641711:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789176547.641739:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176547.641758:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf33c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176547.641796:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875200 00000100:00100000:3.0:1789176547.641801:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875200 00000100:00100000:3.0:1789176547.641852:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789176547.641859:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+18:24218:x1876086975875200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176547.641868:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176547.641882:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c055639a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556393 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.641902:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c055639a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556393 expref: 19 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.641912:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c055639a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556393 expref: 19 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.641927:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495000, rc 0) 00000100:00100000:3.0:1789176547.641961:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875200:12345-0@lo:101:mount.lustre.0 Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176547.641968:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789176547.642200:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176547.642212:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055639a expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176547.642232:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055639a expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176547.646055:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789176547.648007:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176547.655931:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789176547.656001:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789176547.656488:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789176547.656513:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789176547.656552:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789176547.656568:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789176547.656581:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789176547.656593:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789176547.656606:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789176547.656619:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789176547.656632:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789176547.656645:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789176547.656670:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789176547.656676:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789176547.656788:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176547.656874:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.656917:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.657028:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875328 00000100:00100000:0.0:1789176547.657035:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875328 00000100:00100000:0.0:1789176547.657086:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789176547.657096:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176547.657260:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875328:12345-0@lo:501:mount.lustre.0 Request processed in 165us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.657269:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789176547.657302:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176547.657643:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176547.657683:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.657713:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176547.658220:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875456 00000100:00100000:2.0:1789176547.658227:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875456 00000100:00100000:2.0:1789176547.658269:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789176547.658277:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176547.659689:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875456:12345-0@lo:503:mount.lustre.0 Request processed in 1408us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.659701:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789176547.660898:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789176547.661435:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789176547.661514:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176547.661588:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.663564:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.665053:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875584 00000100:00100000:0.0:1789176547.665065:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875584 00000100:00100000:0.0:1789176547.665125:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789176547.665135:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.665894:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875584:12345-0@lo:502:mount.lustre.0 Request processed in 757us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.665904:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789176547.666692:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176547.667083:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789176547.667223:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789176547.667240:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789176547.667258:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789176547.667275:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789176547.667291:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789176547.667309:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789176547.667322:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789176547.667632:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1789176547.667656:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1789176547.667673:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1789176547.667686:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1789176547.667732:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176547.668010:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.668106:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176547.668224:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875712 00000100:00100000:2.0:1789176547.668244:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875712 00000100:00100000:2.0:1789176547.668298:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789176547.668307:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176547.668434:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875712:12345-0@lo:502:mount.lustre.0 Request processed in 127us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.668441:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789176547.669050:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789176547.669137:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789176547.669150:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789176547.672799:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176547.672811:0:24235:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789176547.672819:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.672821:0:24235:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789176547.673260:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176547.673279:0:24235:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f0ac7ca4d40) 00000020:00000080:2.0:1789176547.673307:0:24235:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789176547.673323:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789176547.673407:0:24235:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac7f8b000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789176547.673416:0:24235:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789176547.673423:0:24235:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b53e3d2c05563a8 00010000:00010000:2.0:1789176547.685742:0:24235:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789176547.688252:0:24235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1789176547.692408:0:24235:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789176547.708360:0:24235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789176547.708373:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176547.708381:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.708383:0:24235:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789176547.708386:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789176547.708389:0:24235:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789176547.708391:0:24235:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176547.708393:0:24235:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176547.708394:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789176547.708397:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.708398:0:24235:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789176547.708401:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176547.708404:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.708406:0:24235:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789176547.708408:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789176547.708410:0:24235:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789176547.708412:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176547.708415:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.708416:0:24235:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789176547.708418:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176547.708420:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.708422:0:24235:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789176547.708425:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789176547.708455:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176547.708459:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176547.708461:0:24235:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789176547.708465:0:24235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789176547.715957:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789176547.716090:0:24218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789176547.716123:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055639a expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.716137:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3000/0x4b53e3d2c0556393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055639a expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176547.716146:0:24218:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac7f8b000 from 1 10000000:01000000:0.0:1789176547.716149:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176547.716187:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.716196:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.716208:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176547.716676:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176547.716745:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.716814:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176547.716896:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875840 00000100:00100000:3.0:1789176547.716904:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875840 00000100:00100000:3.0:1789176547.716956:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176547.717145:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:24218:x1876086975875840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176547.717158:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176547.717173:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05563af expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.717197:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 20 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.717227:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 20 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.717237:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494c00, rc 0) 00000100:00100000:3.0:1789176547.717283:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975875840:12345-0@lo:101:mount.lustre.0 Request processed in 143us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176547.717290:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789176547.717584:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176547.717599:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.717621:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176547.720326:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789176547.721346:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176547.721736:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789176547.721763:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789176547.721796:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789176547.721817:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789176547.721863:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789176547.722667:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789176547.722681:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789176547.722693:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789176547.722708:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789176547.722722:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789176547.722737:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789176547.722759:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789176547.722766:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789176547.723632:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176547.723698:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.723746:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789176547.723893:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975875968 00000100:00100000:3.0:1789176547.723902:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975875968 00000100:00100000:3.0:1789176547.723949:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789176547.723967:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975875968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176547.724290:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975875968:12345-0@lo:501:mount.lustre.0 Request processed in 332us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176547.724298:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789176547.726765:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975875968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176547.726827:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176547.727052:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.727088:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789176547.727209:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876096 00000100:00100000:3.0:1789176547.727216:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876096 00000100:00100000:3.0:1789176547.727267:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789176547.727276:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176547.727394:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876096:12345-0@lo:503:mount.lustre.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176547.727402:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789176547.727577:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176547.728160:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176547.729652:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.729735:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.729783:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176547.729906:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876224 00000100:00100000:3.0:1789176547.729913:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876224 00000100:00100000:3.0:1789176547.730082:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789176547.730094:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176547.730212:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876224:12345-0@lo:502:mount.lustre.0 Request processed in 120us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176547.730227:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789176547.730283:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176547.730502:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789176547.731349:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789176547.731378:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789176547.731392:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789176547.731423:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789176547.731437:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789176547.731448:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789176547.731461:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789176547.731473:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789176547.731485:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789176547.731497:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789176547.731956:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176547.732168:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.732205:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd891e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789176547.732240:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876352 00000100:00100000:2.0:1789176547.732248:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876352 00000100:00100000:2.0:1789176547.732292:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789176547.732300:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176547.732407:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876352:12345-0@lo:502:mount.lustre.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.732416:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789176547.732799:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176547.732898:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1789176547.732908:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789176547.740507:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176547.740520:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740523:0:24239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789176547.740530:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac7f8b000 00000020:00000080:1.0:1789176547.740533:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176547.740551:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176547.740554:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740555:0:24239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789176547.740558:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176547.740560:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740561:0:24239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789176547.740565:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac7f8b000 00000020:00000080:1.0:1789176547.740567:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176547.740624:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176547.740628:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740629:0:24239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789176547.740631:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176547.740634:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740635:0:24239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176547.740638:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac7f8b000 00000020:00000080:1.0:1789176547.740640:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176547.740660:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176547.740672:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740673:0:24239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176547.740676:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176547.740679:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740680:0:24239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789176547.740683:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac7f8b000 00000020:00000080:1.0:1789176547.740685:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176547.740712:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176547.740715:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176547.740717:0:24239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789176547.740720:0:24239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789176547.742021:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789176547.742072:0:24218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176547.742094:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.742106:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176547.742183:0:24218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789176547.742187:0:24218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0ac7f8b000 10000000:01000000:3.0:1789176547.742191:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0ac7f8b000 10000000:01000000:3.0:1789176547.742196:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176547.742202:0:24218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac7f8b000 from 1 10000000:01000000:3.0:1789176547.742212:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789176547.742250:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.742259:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.742270:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176547.742296:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176547.742365:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.742400:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd891e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.744677:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876480 00000100:00100000:0.0:1789176547.744692:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876480 00000100:00100000:0.0:1789176547.744748:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789176547.744759:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:24218:x1876086975876480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176547.744775:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176547.744793:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c05563c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05563bd expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.744824:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c05563c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05563bd expref: 21 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.744862:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c05563c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05563bd expref: 21 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.744872:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d800, rc 0) 00000100:00100000:0.0:1789176547.744953:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876480:12345-0@lo:101:mount.lustre.0 Request processed in 196us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.744973:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789176547.747293:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176547.747322:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05563c4 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.747334:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05563c4 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176547.750185:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789176547.750511:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176547.752045:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789176547.752092:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789176547.752107:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789176547.752131:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789176547.752144:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789176547.752157:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789176547.752171:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789176547.752182:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789176547.752195:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789176547.752224:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789176547.752239:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789176547.752250:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789176547.752262:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789176547.752275:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789176547.752288:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789176547.752299:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789176547.752310:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789176547.752321:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789176547.752332:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789176547.752343:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789176547.752356:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789176547.752369:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789176547.752382:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789176547.752395:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789176547.752408:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789176547.752434:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789176547.752450:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789176547.752463:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789176547.752714:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789176547.752740:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789176547.752756:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789176547.752773:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789176547.752788:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789176547.752804:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789176547.752820:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789176547.752863:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789176547.752889:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789176547.752903:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789176547.752916:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789176547.753011:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789176547.753030:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789176547.753059:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789176547.753076:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789176547.753092:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789176547.753111:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789176547.753127:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789176547.753145:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789176547.753160:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789176547.753313:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789176547.753334:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789176547.753939:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789176547.753949:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789176547.754066:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176547.754141:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.754190:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.754216:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876608 00000100:00100000:0.0:1789176547.754224:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876608 00000100:00100000:0.0:1789176547.754273:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176547.754283:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176547.754436:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876608:12345-0@lo:501:mount.lustre.0 Request processed in 154us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.754447:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176547.754519:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176547.754763:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176547.754810:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.754874:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.754894:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876736 00000100:00100000:0.0:1789176547.754899:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876736 00000100:00100000:0.0:1789176547.754942:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789176547.754953:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176547.758130:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876736:12345-0@lo:503:mount.lustre.0 Request processed in 3170us (3310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.758145:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789176547.758233:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176547.758987:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176547.759073:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.759131:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.759172:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876864 00000100:00100000:0.0:1789176547.759179:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876864 00000100:00100000:0.0:1789176547.759219:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176547.759228:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.759325:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876864:12345-0@lo:502:mount.lustre.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.759332:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176547.759377:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.759393:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176547.759807:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789176547.759903:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789176547.760056:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789176547.760081:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789176547.760094:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789176547.760106:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789176547.760131:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789176547.760147:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789176547.760159:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789176547.760170:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789176547.760184:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789176547.760196:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789176547.760210:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789176547.760224:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789176547.760239:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789176547.760254:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789176547.760269:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789176547.760284:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789176547.760313:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789176547.760331:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789176547.760618:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789176547.760638:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789176547.760650:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789176547.760660:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789176547.760671:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789176547.760683:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789176547.760695:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789176547.760708:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789176547.760720:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789176547.760733:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789176547.760744:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789176547.760755:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789176547.760767:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789176547.760781:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789176547.760809:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789176547.760826:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789176547.760869:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789176547.760884:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789176547.760898:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789176547.761761:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789176547.761797:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789176547.761812:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789176547.761848:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789176547.761867:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789176547.761883:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789176547.761894:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789176547.761907:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789176547.761920:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789176547.761996:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.762073:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.762124:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975876992 00000100:00100000:0.0:1789176547.762131:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975876992 00000100:00100000:0.0:1789176547.762186:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789176547.762196:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.762309:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975876992:12345-0@lo:502:mount.lustre.0 Request processed in 115us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.762318:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789176547.764176:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.764216:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975876992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176547.764450:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789176547.764656:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789176547.764696:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975877120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.764762:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.764807:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877120 00000100:00100000:0.0:1789176547.764815:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877120 00000100:00100000:0.0:1789176547.764876:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789176547.764885:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975877120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176547.765088:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975877120:12345-0@lo:502:mount.lustre.0 Request processed in 203us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176547.765097:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789176547.765149:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176547.765163:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975877120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176547.765204:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789176547.765212:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789176547.766883:0:24244:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789176547.766900:0:24244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f0ac7ca19c0) 00000020:00000080:2.0:1789176547.766932:0:24244:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789176547.767019:0:24244:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac7f8b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176547.767024:0:24244:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac7f8b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176547.767026:0:24244:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac7f8b000 3 00010000:00080000:2.0:1789176547.767054:0:24244:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac7775000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176547.770370:0:24244:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789176547.771591:0:24244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789176547.771642:0:24244:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176547.771656:0:24244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b53e3d2c05563d2 00000100:00080000:2.0:1789176547.771667:0:24244:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176547.771673:0:24244:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac7775000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176547.771710:0:24244:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0beb56ea00 x1876086975877248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176547.771763:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975877248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789176547.771883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176547.772343:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877248 00000100:00100000:2.0:1789176547.772352:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877248 00000100:00100000:2.0:1789176547.772392:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789176547.772399:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975877248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789176547.772441:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:2.0:1789176547.772480:0:22714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b53e3d2c05563d9 00000004:00100000:2.0:1789176547.772495:0:22714:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789176547.772526:0:22714:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176547.772581:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876086975877248:12345-0@lo:38:llog_process_th.0 Request processed in 181us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.772589:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789176547.772626:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0beb56ea00 x1876086975877248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176547.772636:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789176547.772644:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789176547.772651:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789176547.772655:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789176547.772657:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7775000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789176547.772663:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975877248:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789176547.772682:0:24244:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789176547.772724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.772729:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176547.772732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.772734:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176547.772762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.772766:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176547.772769:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.772779:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176547.772812:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975877504:0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.772869:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176547.772889:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176547.772896:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975877376:0@lo:400:kworker.0 00000100:00100000:1.0:1789176547.773203:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877504 00000100:00100000:1.0:1789176547.773210:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877504 00000100:00100000:1.0:1789176547.773243:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176547.773250:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975877504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176547.773290:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975877504:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176547.773296:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176547.773569:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789176547.773601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0beb56ed80 x1876086975877504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176547.773612:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975877504:0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.773638:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975877632:0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.773660:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176547.773687:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176547.773693:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975877760:0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.773714:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176547.773746:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877376 00000100:00100000:2.0:1789176547.773750:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877376 00000100:00100000:2.0:1789176547.773770:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877632 00000100:00100000:2.0:1789176547.773772:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877632 00000100:00100000:2.0:1789176547.773784:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176547.773790:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975877376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.773826:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975877376:12345-0@lo:400:kworker.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.773862:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176547.773875:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789176547.773881:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975877632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.774124:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975877632:12345-0@lo:400:kworker.0 Request processed in 242us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.774131:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789176547.774161:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975877632:0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.774181:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975877376:0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.774195:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877760 00000100:00100000:2.0:1789176547.774199:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877760 00000100:00100000:2.0:1789176547.774264:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176547.774271:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975877760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176547.774306:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975877760:12345-0@lo:400:kworker.0 Request processed in 36us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.774312:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789176547.777156:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0beb56e300 x1876086975877760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176547.777174:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975877760:0@lo:400:kworker.0 00000020:01000004:2.0:1789176547.778470:0:24244:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789176547.778488:0:24244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f0ac7ca0000) 00000020:00000080:2.0:1789176547.778512:0:24244:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789176547.778585:0:24244:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac7f8b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176547.778589:0:24244:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac7f8b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176547.778592:0:24244:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac7f8b000 3 00010000:00080000:2.0:1789176547.778619:0:24244:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bc7036800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176547.789751:0:24244:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789176547.792728:0:24244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789176547.792783:0:24244:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176547.792805:0:24244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4b53e3d2c05563e7 00000100:00080000:2.0:1789176547.792816:0:24244:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176547.792823:0:24244:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f0bc7036800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176547.792883:0:24244:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d59500 x1876086975877888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176547.792912:0:24244:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789176547.792940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.792945:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176547.792948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.792951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176547.792954:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.792958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176547.792960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176547.792963:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789176547.793184:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789176547.793242:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789176547.793281:0:24218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789176547.793298:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05563c4 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.793310:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c05563bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05563c4 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789176547.793354:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789176547.793357:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789176547.793358:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176547.793360:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176547.793362:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176547.793363:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176547.793365:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176547.793367:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176547.793369:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176547.793373:0:24218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789176547.793376:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176547.793377:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789176547.793378:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176547.793380:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176547.793382:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1789176547.793384:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975877888:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1789176547.793384:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176547.793386:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176547.793387:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176547.793392:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176547.793409:0:24218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789176547.793423:0:24218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975878016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789176547.793472:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.793473:0:24218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176547.794213:0:24218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd5cd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176547.795729:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975877888 00000100:00100000:2.0:1789176547.795742:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975877888 00000100:00100000:2.0:1789176547.795788:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176547.795796:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1876086975877888:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789176547.795826:0:23785:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:2.0:1789176547.795897:0:23785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4b53e3d2c05563ee 00000004:00100000:2.0:1789176547.795927:0:23785:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789176547.795963:0:23785:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7775800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176547.796048:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876086975877888:12345-0@lo:38:llog_process_th.0 Request processed in 251us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.796064:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789176547.796116:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0be7d59500 x1876086975877888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176547.796128:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789176547.796136:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789176547.796144:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789176547.796149:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789176547.796151:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7036800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789176547.796157:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975877888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176547.799479:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878016 00000100:00100000:1.0:1789176547.799496:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878016 00000100:00100000:1.0:1789176547.799601:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789176547.799611:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975878016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789176547.799641:0:22709:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789176547.799656:0:22709:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789176547.803119:0:22709:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789176547.803136:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789176547.803415:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789176547.803422:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789176547.803445:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.803464:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176547.803469:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:24218:x1876086975878016:12345-0@lo:253:mount.lustre.0 Request processed in 3856us (9996us total) trans 0 rc 0/0 00010000:00010000:3.0:1789176547.803478:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176547.803487:0:24218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:24218:1876086975878016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789176547.803502:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 10000000:01000000:0.0:1789176547.803505:0:24218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789176547.803510:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:3.0:1789176547.803511:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789176547.803513:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789176547.803517:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176547.803520:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176547.803523:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176547.803526:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176547.803528:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176547.803530:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176547.803532:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789176547.803546:0:24218:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789176547.803561:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.803578:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 20 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176547.803591:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975878144:0@lo:104: 00000100:00100000:3.0:1789176547.803628:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176547.803674:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878144 00000100:00100000:1.0:1789176547.803681:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878144 00010000:00010000:3.0:1789176547.803686:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.803696:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 20 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176547.803707:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975878272:0@lo:104: 00000100:00100000:1.0:1789176547.803732:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176547.803739:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176547.803746:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975878144:12345-0@lo:104: 00000100:00100000:3.0:1789176547.803751:0:22730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dce40 going to sleep for 11 seconds 00010000:00010000:1.0:1789176547.803760:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176547.803816:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176547.803823:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975878144:12345-0@lo:104: Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176547.803852:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176547.803872:0:22697:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789176547.803882:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878272 00000100:00100000:1.0:1789176547.803886:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878272 00000100:00100000:1.0:1789176547.803906:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176547.803926:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be6d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975878272:12345-0@lo:104: 00010000:00010000:1.0:1789176547.803936:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176547.803986:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789176547.803991:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be6d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975878272:12345-0@lo:104: Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176547.803997:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789176547.804112:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176547.804119:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804127:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43aa00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176547.804131:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804139:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176547.804154:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176547.804160:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176547.804194:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804202:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176547.804224:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804232:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43aa00/0x4b53e3d2c0556346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055634d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804243:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176547.804248:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804254:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176547.804258:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804265:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176547.804272:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176547.804278:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176547.804308:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804314:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176547.804321:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804327:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43b400/0x4b53e3d2c0556338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055633f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.804338:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176547.804340:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176547.804341:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176547.804354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975878400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789176547.804381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.804413:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176547.804419:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975878528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789176547.804441:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176547.804483:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975878144:0@lo:104: 00000100:00100000:3.0:1789176547.804491:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975878272:0@lo:104: 00010000:00010000:3.0:1789176547.804504:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176547.804793:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878400 00000100:00100000:2.0:1789176547.804798:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878400 00010000:00010000:2.0:1789176547.804821:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 21 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176547.804906:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878528 00000100:00100000:2.0:1789176547.804919:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878528 00010000:00010000:2.0:1789176547.804932:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 22 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176547.804948:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176547.804954:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:3644:x1876086975878400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176547.804964:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176547.804968:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 22 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.804987:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 22 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805013:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055634d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0556346 expref: 22 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805024:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176547.805060:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975878400:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.805067:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176547.805082:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789176547.805089:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7484850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:3644:x1876086975878528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176547.805096:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176547.805101:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 20 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805112:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 20 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805123:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2800/0x4b53e3d2c055633f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0556338 expref: 20 pid: 22707 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805137:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805146:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789176547.805160:0:22699:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011510252s 00010000:00010000:2.0:1789176547.805166:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805184:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805193:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805200:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805207:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176547.805213:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805221:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805244:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176547.805253:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176547.805276:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7484850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:3644:x1876086975878528:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176547.805283:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789176547.805328:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975878528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176547.805337:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975878400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176547.805403:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.805412:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176547.805419:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c05563f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176547.806138:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789176547.811676:0:24218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789176547.829662:0:24218:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789176547.829673:0:24218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789176547.829708:0:24218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789176547.829763:0:24218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789176547.829788:0:24218:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789176547.829810:0:24218:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789176547.834545:0:24218:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176547.834905:0:24218:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176548.020005:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789176548.608603:0:24298:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176548.608849:0:24298:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176549.042980:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789176549.811694:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176549.811703:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac599b800 from 13 10000000:01000000:1.0:1789176549.811707:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176549.811756:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176549.811781:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176549.811794:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176549.811821:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975878656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176549.811940:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176549.811983:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc53493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176549.812097:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878656 00000100:00100000:0.0:1789176549.812105:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878656 00000100:00100000:0.0:1789176549.812155:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789176549.812164:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+19:22711:x1876086975878656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176549.812176:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176549.812192:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05563fc expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176549.812215:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 20 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176549.812226:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 20 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176549.812245:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c600, rc 0) 00000100:00100000:0.0:1789176549.812294:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:22711:x1876086975878656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176549.812301:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789176549.812649:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975878656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176549.812664:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176549.812674:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176549.812724:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975878784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789176549.812755:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176549.812778:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc53493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176549.812826:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878784 00000100:00100000:0.0:1789176549.812857:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878784 00000100:00100000:0.0:1789176549.812886:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789176549.812893:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:22711:x1876086975878784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789176549.812908:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789176549.813823:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789176549.813827:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789176549.814284:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:22711:x1876086975878784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1388us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176549.814295:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176549.817188:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975878784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789176549.817274:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176549.817286:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176549.817368:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176549.817381:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176549.817384:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bfbff9000 from 13 10000000:01000000:2.0:1789176549.817387:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176549.817431:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176549.817440:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176549.817450:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176549.817480:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975878912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176549.817542:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176549.818258:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc6745480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176549.821114:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975878912 00000100:00100000:1.0:1789176549.821128:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975878912 00000100:00100000:1.0:1789176549.821195:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789176549.821206:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:22711:x1876086975878912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176549.821223:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176549.821347:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055640a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176549.821393:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176549.821404:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176549.821413:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3800, rc 0) 00000100:00100000:1.0:1789176549.821529:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975878912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176549.821536:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789176549.821602:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975878912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176549.821626:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176549.821635:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176549.821696:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975879040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789176549.821735:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176549.821802:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc6745480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176549.821895:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879040 00000100:00100000:1.0:1789176549.821899:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879040 00000100:00100000:1.0:1789176549.821976:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789176549.821985:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975879040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789176549.822001:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176549.822019:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176549.822022:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1789176549.822108:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975879040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176549.822115:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789176549.822377:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975879040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789176549.822438:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176549.822446:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176549.822453:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176549.938000:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975879168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176549.938076:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176549.939995:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975879296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176549.942781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176549.942908:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879168 00000100:00100000:3.0:1789176549.942918:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879168 00000100:00100000:3.0:1789176549.942955:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879296 00000100:00100000:3.0:1789176549.942970:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879296 00000100:00100000:1.0:1789176549.942980:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789176549.942992:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975879168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176549.943037:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789176549.943113:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975879168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (5037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176549.943431:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975879168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176549.952661:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789176549.952713:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176549.952728:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975879296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176549.952769:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176549.952870:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975879296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (10094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176549.952877:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789176549.952936:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975879296:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789176550.065964:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176551.091092:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176552.117092:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176553.014812:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975879424:0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.015080:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176553.015390:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975879552:0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.015433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176553.015487:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879552 00000100:00100000:3.0:1789176553.015496:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879552 00000100:00100000:3.0:1789176553.015545:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176553.015554:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975879552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.015621:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975879552:12345-0@lo:400:kworker.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176553.015628:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176553.015665:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975879552:0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.016243:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879424 00000100:00100000:3.0:1789176553.016250:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879424 00000100:00100000:3.0:1789176553.016281:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789176553.016289:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975879424:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789176553.017465:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176553.017473:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176553.017476:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176553.017479:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176553.017532:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176553.017535:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176553.017538:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176553.017550:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176553.017855:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975879424:12345-0@lo:400:kworker.0 Request processed in 1561us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176553.017866:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789176553.017921:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975879808:0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.017999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176553.018028:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789176553.018034:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975879680:0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.018058:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176553.018077:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975880192:0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.018099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176553.018125:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879680 00000100:00100000:3.0:1789176553.018131:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879680 00000100:00100000:3.0:1789176553.018162:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880192 00000100:00100000:3.0:1789176553.018164:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880192 00000100:00100000:3.0:1789176553.018196:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176553.018203:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975879680:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789176553.018243:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176553.018248:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975879680:12345-0@lo:400:kworker.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176553.018256:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176553.018269:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789176553.018276:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975880192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176553.018306:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975880192:12345-0@lo:400:kworker.0 Request processed in 31us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176553.018312:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789176553.018800:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac8720e00 x1876086975879680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176553.018815:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975879680:0@lo:400:kworker.0 00010000:00080000:3.0:1789176553.018825:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3091f80 x1876086975880192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176553.020845:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975879424:0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.020885:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975879936:0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.021110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176553.021146:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176553.021154:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975880064:0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.021175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176553.021182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975880192:0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.021217:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879808 00000100:00100000:2.0:1789176553.021223:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879808 00000100:00100000:2.0:1789176553.021581:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789176553.021591:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975879808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.021650:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975879808:12345-0@lo:400:kworker.0 Request processed in 59us (3650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176553.021657:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789176553.024077:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975879936 00000100:00100000:2.0:1789176553.024092:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975879936 00000100:00100000:2.0:1789176553.024143:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880064 00000100:00100000:2.0:1789176553.024147:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880064 00000100:00100000:2.0:1789176553.024225:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176553.024235:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975879936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.024323:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975879936:12345-0@lo:400:kworker.0 Request processed in 90us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176553.024340:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176553.024356:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176553.024362:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975880064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176553.024391:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975880064:12345-0@lo:400:kworker.0 Request processed in 29us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176553.024398:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176553.024464:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975879808:0@lo:400:kworker.0 00010000:00080000:2.0:1789176553.024526:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3091880 x1876086975880064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176553.024538:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975880064:0@lo:400:kworker.0 00010000:00080000:2.0:1789176553.024550:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3090700 x1876086975879936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176553.024559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975879936:0@lo:400:kworker.0 00000100:00080000:3.0:1789176553.030426:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789176553.141278:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176553.532522:0:24588:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1789176553.715688:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789176554.162105:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789176554.435468:0:24641:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176554.435935:0:24641:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789176555.058156:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176555.058185:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975880320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176555.058272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176555.058340:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880320 00000100:00100000:3.0:1789176555.058349:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880320 00000100:00100000:3.0:1789176555.058404:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176555.058413:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975880320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176555.058453:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789176555.058499:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975880320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176555.058506:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176555.058551:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975880320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176555.059205:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975880448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176555.059250:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176555.062255:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880448 00000100:00100000:2.0:1789176555.062274:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880448 00000100:00100000:2.0:1789176555.062459:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176555.062472:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975880448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176555.062522:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789176555.062639:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975880448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176555.062647:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176555.062752:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975880448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789176555.187076:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176555.256404:0:24691:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176555.256710:0:24691:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789176556.210764:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789176556.854008:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789176557.241937:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789176558.133030:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176558.133037:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176558.133040:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176558.133044:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176558.133060:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176558.133063:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176558.133066:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176558.133069:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789176558.133107:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975880832:0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.133170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176558.133225:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975881344:0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.133250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176558.133273:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789176558.133279:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975880704:0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.133300:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176558.133320:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975881216:0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.133352:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176558.133379:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880832 00000100:00100000:0.0:1789176558.133385:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880832 00000100:00100000:0.0:1789176558.133423:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881344 00000100:00100000:0.0:1789176558.133425:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881344 00000100:00100000:0.0:1789176558.133443:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881216 00000100:00100000:0.0:1789176558.133446:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881216 00000100:00100000:0.0:1789176558.133461:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176558.133569:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975880960:0@lo:400:kworker.0 00000100:00100000:1.0:1789176558.133600:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176558.133619:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789176558.133625:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975880576:0@lo:400:kworker.0 00000100:00100000:1.0:1789176558.133650:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176558.133671:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975881088:0@lo:400:kworker.0 00000100:00100000:1.0:1789176558.133689:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176558.133709:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880576 00000100:00100000:1.0:1789176558.133712:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880576 00000100:00100000:1.0:1789176558.133736:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789176558.133742:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975880576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176558.133784:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975880576:12345-0@lo:400:kworker.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176558.133790:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789176558.133858:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975880576:0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.133918:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975880832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.133961:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975880832:12345-0@lo:400:kworker.0 Request processed in 492us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176558.133968:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176558.133981:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881088 00000100:00100000:0.0:1789176558.133984:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881088 00000100:00100000:0.0:1789176558.133999:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176558.134005:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.134031:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975881344:12345-0@lo:400:kworker.0 Request processed in 27us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176558.134037:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176558.134048:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789176558.134054:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975881216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.134078:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975881216:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176558.134083:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789176558.134094:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176558.134100:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975881088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.134128:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975881088:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176558.134139:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176558.134162:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880704 00000100:00100000:0.0:1789176558.134165:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880704 00000100:00100000:0.0:1789176558.134187:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975880960 00000100:00100000:0.0:1789176558.134189:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975880960 00000100:00100000:0.0:1789176558.134201:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176558.134207:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975880704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.134237:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975880704:12345-0@lo:400:kworker.0 Request processed in 30us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176558.134242:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176558.134253:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176558.134258:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975880960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.134283:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975880960:12345-0@lo:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176558.134288:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789176558.134322:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3092a00 x1876086975881088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176558.134333:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975881088:0@lo:400:kworker.0 00000100:00100000:0.0:1789176558.134342:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975880960:0@lo:400:kworker.0 00000100:00080000:3.0:1789176558.134419:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176558.134424:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176558.134497:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975880704:0@lo:400:kworker.0 00010000:00080000:1.0:1789176558.134512:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3093b80 x1876086975881216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176558.134520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975881216:0@lo:400:kworker.0 00010000:00080000:1.0:1789176558.134530:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3092300 x1876086975880832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176558.134538:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975880832:0@lo:400:kworker.0 00010000:00080000:1.0:1789176558.134547:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3092d80 x1876086975881344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176558.134555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975881344:0@lo:400:kworker.0 00010000:00010000:0.0:1789176558.260252:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176559.028592:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176544/real 1789176544] req@ffff9f0beb56e680 x1876086975873408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.028623:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0beb56e680 x1876086975873408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.028634:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176544/real 1789176544] req@ffff9f0beb56d500 x1876086975873536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.028646:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0beb56d500 x1876086975873536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789176559.028673:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176559.028694:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789176559.028698:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975873408:0@lo:8:kworker.0 00000100:00080000:3.0:1789176559.028704:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176559.028709:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789176559.028712:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975873536:0@lo:8:kworker.0 00000100:00080000:3.0:1789176559.028795:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176559.028800:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176559.028803:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176559.028806:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176559.028846:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176559.028850:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789176559.028852:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176559.028857:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:3.0:1789176559.028862:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789176559.028869:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0bfb8c3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176559.028888:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776f480 x1876086975881984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176559.028909:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176559.028912:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789176559.028914:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176559.028917:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:3.0:1789176559.028925:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789176559.028928:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bc28a9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176559.028939:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776e300 x1876086975882112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176559.028975:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975881472:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975882240:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029108:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789176559.029113:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975881600:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029134:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029150:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975882368:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029200:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975881728:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029224:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029242:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975882496:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029277:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176559.029282:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975881856:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029304:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.029335:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881472 00000100:00100000:3.0:1789176559.029342:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881472 00000100:00100000:3.0:1789176559.029386:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789176559.029395:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029439:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:3644:x1876086975881472:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029453:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789176559.029500:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882240 00000100:00100000:3.0:1789176559.029504:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882240 00000100:00100000:3.0:1789176559.029522:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882368 00000100:00100000:3.0:1789176559.029525:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882368 00000100:00100000:3.0:1789176559.029536:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881728 00000100:00100000:3.0:1789176559.029538:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881728 00000100:00100000:3.0:1789176559.029547:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882496 00000100:00100000:3.0:1789176559.029550:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882496 00000100:00100000:3.0:1789176559.029560:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789176559.029566:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975882240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029598:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975882240:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029604:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789176559.029615:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176559.029620:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975882368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029645:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975882368:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029651:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176559.029660:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176559.029666:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975881728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029696:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975881728:12345-0@lo:400:kworker.0 Request processed in 30us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029702:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176559.029714:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176559.029719:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975882496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029756:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975882496:12345-0@lo:400:kworker.0 Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029762:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176559.029781:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881600 00000100:00100000:3.0:1789176559.029785:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881600 00000100:00100000:3.0:1789176559.029804:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881856 00000100:00100000:3.0:1789176559.029806:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881856 00000100:00100000:3.0:1789176559.029817:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176559.029822:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975881600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029879:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975881600:12345-0@lo:400:kworker.0 Request processed in 57us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029885:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176559.029906:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176559.029912:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975881856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.029936:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975881856:12345-0@lo:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.029942:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176559.029989:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975881856:0@lo:400:kworker.0 00010000:00080000:3.0:1789176559.029999:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac776c700 x1876086975881728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.030008:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975881728:0@lo:400:kworker.0 00010000:00080000:3.0:1789176559.030016:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd4e0e00 x1876086975882496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.030024:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975882496:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.030048:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975881984:0@lo:8:kworker.0 00000100:00100000:3.0:1789176559.030085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.030105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975882112:0@lo:8:kworker.0 00000100:00100000:3.0:1789176559.030140:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176559.030182:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975881600:0@lo:400:kworker.0 00010000:00080000:3.0:1789176559.030192:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd4e3100 x1876086975882368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.030198:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975882368:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.030205:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975881472:0@lo:400:kworker.0 00010000:00080000:3.0:1789176559.030213:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd4e3b80 x1876086975882240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176559.030220:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975882240:0@lo:400:kworker.0 00000100:00100000:3.0:1789176559.030259:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975881984 00000100:00100000:3.0:1789176559.030263:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975881984 00000100:00100000:3.0:1789176559.030276:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882112 00000100:00100000:3.0:1789176559.030278:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882112 00000100:00100000:3.0:1789176559.030286:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176559.030290:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975881984:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789176559.030313:0:24224:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:3.0:1789176559.030338:0:24224:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0556418 00002000:00100000:3.0:1789176559.030350:0:24224:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f0bc52d6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789176559.030355:0:24224:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789176559.030358:0:24224:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789176559.030530:0:24224:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789176559.030550:0:24224:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176559.030594:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975881984:12345-0@lo:8:kworker.0 Request processed in 302us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176559.030600:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176559.030615:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176559.030619:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975882112:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789176559.030629:0:24224:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789176559.034312:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac776f480 x1876086975881984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176559.034327:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176559.034337:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789176559.034346:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789176559.034360:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789176559.034364:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789176559.034388:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789176559.034395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975881984:0@lo:8:kworker.0 00000004:00080000:2.0:1789176559.034399:0:23457:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789176559.034479:0:23458:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000004:00080000:2.0:1789176559.034495:0:23457:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 680295662931ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789176559.034505:0:23457:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789176559.034505:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1876086975882752:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789176559.034564:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176559.034592:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176559.034743:0:24222:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789176559.034752:0:24222:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789176559.034758:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975882624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176559.034793:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176559.034886:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882752 00000100:00100000:0.0:1789176559.034902:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882752 00000100:00100000:2.0:1789176559.035011:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882624 00000100:00100000:0.0:1789176559.035011:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789176559.035018:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882624 00000100:00100000:0.0:1789176559.035025:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23458:x1876086975882752:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789176559.035056:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176559.035064:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876086975882624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176559.035085:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789176559.035130:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876086975882624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176559.035144:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789176559.035176:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3093480 x1876086975882624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176559.035194:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975882624:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789176559.035301:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789176559.038008:0:23448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789176559.055954:0:24884:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789176559.055965:0:24884:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789176559.056064:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23458:x1876086975882752:12345-0@lo:7:osp-pre-0-1.0 Request processed in 21038us (21495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176559.056080:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789176559.056099:0:23458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3092a00 x1876086975882752/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176575 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176559.056116:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1876086975882752:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789176559.056132:0:23458:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789176559.056272:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1876086975882880:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789176559.056311:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176559.056342:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd84939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176559.056371:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975882880 00000100:00100000:0.0:1789176559.056378:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975882880 00000100:00100000:0.0:1789176559.056423:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176559.056431:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23458:x1876086975882880:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789176559.056455:0:24222:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789176559.056496:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23458:x1876086975882880:12345-0@lo:5:osp-pre-0-1.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176559.056503:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789176559.056783:0:23458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3092a00 x1876086975882880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176575 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176559.056794:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1876086975882880:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789176559.056805:0:23458:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789176559.056944:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1876086975883008:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789176559.056979:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176559.057041:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc35296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176559.057170:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883008 00000100:00100000:1.0:1789176559.057176:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883008 00000100:00100000:1.0:1789176559.057246:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176559.057256:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23458:x1876086975883008:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789176559.057284:0:24884:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1789176559.063053:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975882112:12345-0@lo:8:kworker.0 Request processed in 32424us (32903us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176559.063067:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789176559.066005:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176559.066015:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789176559.066020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975882112:0@lo:8:kworker.0 00000001:00080000:0.0:1789176559.091753:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1789176559.091771:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789176559.091994:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23458:x1876086975883008:12345-0@lo:5:osp-pre-0-1.0 Request processed in 34735us (35011us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789176559.092006:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789176559.092775:0:23458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0be7d5a300 x1876086975883008/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176575 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176559.092789:0:23458:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789176559.092796:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1876086975883008:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789176559.092812:0:23458:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1789176559.093076:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23458:1876086975883136:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789176559.094111:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176559.094282:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc35296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176559.094535:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883136 00000100:00100000:1.0:1789176559.094543:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883136 00000100:00100000:1.0:1789176559.094598:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176559.094609:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23458:x1876086975883136:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789176559.094757:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23458:x1876086975883136:12345-0@lo:900:osp-pre-0-1.0 Request processed in 150us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176559.094764:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789176559.094888:0:23458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0be7d5a300 x1876086975883136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176575 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176559.094918:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23458:1876086975883136:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1789176559.282714:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176560.178632:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975883392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176560.178706:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176560.178754:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176560.178760:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975883264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176560.178784:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176560.178816:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883392 00000100:00100000:0.0:1789176560.178823:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883392 00000100:00100000:2.0:1789176560.178871:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883264 00000100:00100000:2.0:1789176560.178876:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883264 00000100:00100000:0.0:1789176560.178899:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176560.178907:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975883392:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176560.178909:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789176560.178915:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975883264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176560.178940:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000004:00000024:0.0:1789176560.178940:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176560.178994:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975883264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176560.179001:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176560.179975:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975883392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1064us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176560.179984:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789176560.182867:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975883264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176560.182911:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975883392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789176560.309032:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176561.332573:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789176561.833454:0:25038:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789176561.833458:0:25038:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789176561.833460:0:25038:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789176561.834501:0:25038:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0ac77d3800 00000020:01000004:0.0:1789176561.834518:0:25038:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789176561.834614:0:25038:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789176561.834631:0:25038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f0bf7208000) 00000020:00000080:0.0:1789176561.834649:0:25038:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789176561.900016:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789176561.902497:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789176561.903014:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789176561.903232:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789176561.903437:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789176561.903714:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789176561.903994:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1789176561.905067:0:25038:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789176561.905290:0:25038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789176561.905305:0:25038:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789176561.905317:0:25038:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b53e3d2c0556426 00000020:01000004:3.0:1789176561.905322:0:25038:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789176561.905342:0:25038:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789176561.905346:0:25038:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789176561.905351:0:25038:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789176561.905379:0:25038:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789176561.905382:0:25038:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789176561.923376:0:25038:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789176561.923420:0:25038:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789176561.923425:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789176561.923427:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789176561.923428:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176561.923429:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176561.923430:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176561.923432:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176561.923433:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176561.923435:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176561.923436:0:25038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789176561.923440:0:25038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789176561.923454:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789176561.923456:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789176561.923457:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176561.923458:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176561.923459:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176561.923461:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176561.923462:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176561.923463:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176561.923470:0:25038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789176561.923499:0:25038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789176561.923518:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789176561.923585:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176561.923700:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc312cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176561.923799:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883520 00000100:00100000:3.0:1789176561.923807:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883520 00000100:00100000:3.0:1789176561.924095:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789176561.924105:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:25038:x1876086975883520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789176561.924137:0:22707:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789176561.924141:0:22707:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789176561.924145:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789176561.924621:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:25038:x1876086975883520:12345-0@lo:253:mount.lustre.0 Request processed in 517us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176561.924630:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789176561.924773:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789176561.924785:0:25038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789176561.924787:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789176561.924788:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789176561.924790:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176561.924791:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176561.924792:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176561.924794:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176561.924795:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176561.924797:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176561.924798:0:25038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789176561.924818:0:25038:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac77d3800 from lustre-OST0001 10000000:01000000:2.0:1789176561.924864:0:25038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789176561.924867:0:25038:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789176561.924884:0:25038:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0bd16fcd40 local copy 00010000:00010000:2.0:1789176561.924894:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176561.924985:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176561.925019:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176561.925088:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc312180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176561.925121:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883648 00000100:00100000:3.0:1789176561.925127:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883648 00000100:00100000:3.0:1789176561.925186:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789176561.925194:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:25038:x1876086975883648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176561.925266:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:25038:x1876086975883648:12345-0@lo:501:mount.lustre.0 Request processed in 72us (245us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789176561.925273:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789176561.925340:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883648:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789176561.925364:0:25038:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789176561.925386:0:25038:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789176561.925392:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176561.925400:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2600/0x4b53e3d2c0556140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556147 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176561.925426:0:25038:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0ac77d3800 10000000:01000000:0.0:1789176561.925430:0:25038:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789176561.925435:0:25038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789176561.925437:0:25038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789176561.925441:0:25038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789176561.925453:0:25038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789176561.925475:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176561.925483:0:25038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176561.925492:0:25038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176561.925505:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176561.925531:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176561.925754:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.925891:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883776 00000100:00100000:2.0:1789176561.925895:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883776 00000100:00100000:2.0:1789176561.925919:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789176561.925926:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:25038:x1876086975883776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176561.925934:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176561.925954:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43aa00/0x4b53e3d2c0556434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055642d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.925974:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43aa00/0x4b53e3d2c0556434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055642d expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.925985:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43aa00/0x4b53e3d2c0556434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055642d expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.925994:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43aa00, rc 0) 00000100:00100000:2.0:1789176561.926024:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975883776:12345-0@lo:101:mount.lustre.0 Request processed in 98us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.926030:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789176561.926100:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176561.926112:0:25038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556434 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176561.926128:0:25038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556434 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176561.927178:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1789176561.930749:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176561.933052:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789176561.933111:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789176561.933129:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789176561.933144:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789176561.933157:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789176561.933169:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789176561.933181:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789176561.933195:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789176561.933209:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1789176561.933234:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1789176561.933240:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1789176561.933339:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176561.933412:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176561.933750:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176561.933813:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975883904 00000100:00100000:1.0:1789176561.933820:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975883904 00000100:00100000:2.0:1789176561.933954:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789176561.933966:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975883904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176561.934158:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975883904:12345-0@lo:501:mount.lustre.0 Request processed in 194us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.934166:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176561.934293:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975883904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176561.934331:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176561.934376:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176561.934456:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176561.934557:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884032 00000100:00100000:1.0:1789176561.934562:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884032 00000100:00100000:1.0:1789176561.934582:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789176561.934589:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176561.935391:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884032:12345-0@lo:503:mount.lustre.0 Request processed in 799us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176561.935401:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789176561.935535:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884032:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176561.936071:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176561.936148:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176561.936205:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176561.936232:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.936315:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884160 00000100:00100000:2.0:1789176561.936322:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884160 00000100:00100000:2.0:1789176561.936350:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176561.936358:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176561.936794:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884160:12345-0@lo:502:mount.lustre.0 Request processed in 436us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.936802:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789176561.936984:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176561.937151:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789176561.937181:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789176561.937196:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789176561.937208:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789176561.937221:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789176561.937234:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789176561.937249:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789176561.937262:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789176561.937275:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1789176561.937301:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176561.937342:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176561.937374:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.937707:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884288 00000100:00100000:2.0:1789176561.937713:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884288 00000100:00100000:2.0:1789176561.937753:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789176561.937767:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176561.937913:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884288:12345-0@lo:502:mount.lustre.0 Request processed in 147us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.937920:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789176561.938104:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176561.938155:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1789176561.938164:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789176561.939144:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176561.939153:0:25042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789176561.939161:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176561.939163:0:25042:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789176561.939168:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176561.939183:0:25042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f0ac7ca3380) 00000020:00000080:2.0:1789176561.939208:0:25042:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789176561.939214:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789176561.939277:0:25042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac77d3800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789176561.939286:0:25042:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789176561.939301:0:25042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b53e3d2c0556442 00010000:00010000:2.0:1789176561.943703:0:25042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789176561.944174:0:25042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789176561.945907:0:25042:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789176561.947273:0:25042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789176561.947284:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176561.947290:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176561.947293:0:25042:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789176561.947296:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176561.947300:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176561.947301:0:25042:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789176561.947304:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789176561.947306:0:25042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789176561.947308:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176561.947310:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176561.947311:0:25042:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789176561.947313:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176561.947322:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176561.947323:0:25042:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789176561.947327:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789176561.947353:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176561.947356:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176561.947357:0:25042:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789176561.947360:0:25042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1789176561.947870:0:25038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789176561.947911:0:25038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789176561.947936:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556434 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176561.947948:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c055642d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556434 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176561.947968:0:25038:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac77d3800 from 1 10000000:01000000:1.0:1789176561.947972:0:25038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176561.948009:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176561.948017:0:25038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176561.948028:0:25038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176561.948052:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789176561.948115:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176561.948153:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.948288:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884416 00000100:00100000:2.0:1789176561.948297:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884416 00000100:00100000:2.0:1789176561.948333:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789176561.948341:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:25038:x1876086975884416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176561.948353:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176561.948367:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556449 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.948388:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.948399:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.948406:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43a400, rc 0) 00000100:00100000:2.0:1789176561.948585:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884416:12345-0@lo:101:mount.lustre.0 Request processed in 244us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.948592:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789176561.950452:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176561.950479:0:25038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176561.950491:0:25038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176561.954184:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789176561.954501:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176561.954717:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789176561.954755:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789176561.954771:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789176561.954784:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789176561.954805:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789176561.954819:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789176561.954862:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789176561.954889:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1789176561.955173:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1789176561.955195:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1789176561.955211:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1789176561.955231:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1789176561.955237:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1789176561.955332:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176561.955402:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176561.955446:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493480 going to sleep for 11 seconds 00000100:00100000:3.0:1789176561.955545:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884544 00000100:00100000:3.0:1789176561.955553:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884544 00000100:00100000:3.0:1789176561.955617:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789176561.955626:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176561.959437:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884544:12345-0@lo:501:mount.lustre.0 Request processed in 3806us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176561.959437:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176561.959451:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789176561.959503:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176561.959565:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176561.959599:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.961313:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884672 00000100:00100000:2.0:1789176561.961325:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884672 00000100:00100000:2.0:1789176561.961374:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789176561.961383:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176561.962160:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884672:12345-0@lo:503:mount.lustre.0 Request processed in 774us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.962176:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789176561.962371:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789176561.963224:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789176561.963317:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176561.963378:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176561.963412:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd828b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789176561.963435:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884800 00000100:00100000:3.0:1789176561.963442:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884800 00000100:00100000:3.0:1789176561.963490:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789176561.963497:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176561.963591:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884800:12345-0@lo:502:mount.lustre.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176561.963598:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789176561.965116:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176561.965334:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789176561.965365:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789176561.965381:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789176561.965409:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789176561.965428:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789176561.965702:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789176561.965726:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789176561.965752:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789176561.965767:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789176561.965780:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789176561.965792:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789176561.965823:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176561.966390:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176561.966430:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd828b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.967145:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975884928 00000100:00100000:2.0:1789176561.967154:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975884928 00000100:00100000:2.0:1789176561.967200:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789176561.967209:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176561.967482:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975884928:12345-0@lo:502:mount.lustre.0 Request processed in 274us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176561.967490:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789176561.967561:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975884928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176561.967647:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1789176561.967660:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789176561.968726:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176561.968737:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.968739:0:25046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789176561.968745:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac77d3800 00000020:00000080:3.0:1789176561.968747:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176561.968755:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176561.968757:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.968758:0:25046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789176561.968760:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176561.969262:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.969265:0:25046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789176561.969271:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac77d3800 00000020:00000080:3.0:1789176561.969273:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176561.969360:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176561.969365:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.969366:0:25046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789176561.969369:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176561.969371:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.969372:0:25046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176561.969375:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac77d3800 00000020:00000080:3.0:1789176561.969377:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176561.973753:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176561.973769:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.973771:0:25046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176561.973775:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176561.973779:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.973781:0:25046:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789176561.973786:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac77d3800 00000020:00000080:3.0:1789176561.973789:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176561.973891:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176561.973895:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176561.973897:0:25046:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789176561.973900:0:25046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789176561.974077:0:25038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789176561.974113:0:25038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176561.974136:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.974147:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176561.974204:0:25038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789176561.974207:0:25038:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0ac77d3800 10000000:01000000:2.0:1789176561.974210:0:25038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0ac77d3800 10000000:01000000:2.0:1789176561.974214:0:25038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789176561.974219:0:25038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac77d3800 from 1 10000000:01000000:2.0:1789176561.974222:0:25038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176561.974256:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.974266:0:25038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.974277:0:25038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176561.974313:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176561.974375:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176561.977975:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885056 00000100:00100000:1.0:1789176561.977995:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885056 00000100:00100000:1.0:1789176561.978059:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789176561.978069:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:25038:x1876086975885056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176561.978084:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176561.978101:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c055645e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556457 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176561.978128:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c055645e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556457 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176561.978139:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c055645e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556457 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176561.978149:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3e00, rc 0) 00000100:00100000:1.0:1789176561.978213:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885056:12345-0@lo:101:mount.lustre.0 Request processed in 146us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176561.978219:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789176561.982941:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789176561.982982:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176561.983007:0:25038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055645e expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176561.983019:0:25038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055645e expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789176561.996930:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789176561.997240:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176561.997424:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789176561.997464:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789176561.997482:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789176561.997494:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789176561.997505:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789176561.997532:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789176561.997545:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789176561.997577:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789176561.997592:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789176561.997604:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789176561.997616:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789176561.997627:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789176561.997639:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789176561.997650:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789176561.997662:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789176561.997675:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789176561.997688:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789176561.997712:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789176561.997726:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789176561.997739:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789176561.997751:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789176561.997778:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789176561.997794:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789176561.997821:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789176561.997881:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789176561.997900:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789176561.997914:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789176561.997928:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789176561.997942:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789176561.997957:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789176561.997972:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789176561.997985:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789176561.997996:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789176561.998008:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789176561.998018:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789176561.998031:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789176561.998043:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789176561.998056:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789176561.998068:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789176561.998094:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789176561.998110:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789176561.998122:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789176561.998133:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789176561.998145:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789176561.998158:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789176561.998170:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789176561.998182:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789176561.998193:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789176561.998309:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789176561.998329:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789176561.998358:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789176561.998363:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789176561.998459:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176561.998519:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176561.998561:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176561.999262:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885184 00000100:00100000:3.0:1789176561.999272:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885184 00000100:00100000:3.0:1789176561.999327:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789176561.999337:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176561.999484:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885184:12345-0@lo:501:mount.lustre.0 Request processed in 148us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176561.999492:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789176562.001715:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176562.001779:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176562.001870:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.001920:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176562.002349:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885312 00000100:00100000:1.0:1789176562.002356:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885312 00000100:00100000:1.0:1789176562.002417:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789176562.002427:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176562.002631:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885312:12345-0@lo:503:mount.lustre.0 Request processed in 205us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176562.002639:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789176562.004253:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789176562.005626:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176562.006561:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176562.006638:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.006683:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176562.008889:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885440 00000100:00100000:1.0:1789176562.008902:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885440 00000100:00100000:1.0:1789176562.008960:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176562.008970:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176562.009130:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885440:12345-0@lo:502:mount.lustre.0 Request processed in 161us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176562.009138:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789176562.009593:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176562.009824:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789176562.009892:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789176562.009923:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789176562.009937:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789176562.009948:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789176562.009961:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789176562.009974:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789176562.009986:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789176562.010000:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789176562.010012:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789176562.010024:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789176562.010035:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789176562.010058:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789176562.010071:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789176562.010083:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789176562.010095:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789176562.010107:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789176562.010118:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789176562.010140:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789176562.010153:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789176562.010166:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789176562.010177:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789176562.010189:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789176562.010201:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789176562.010214:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789176562.010227:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789176562.010239:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789176562.010251:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789176562.010264:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789176562.010276:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789176562.010287:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789176562.010299:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789176562.010310:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789176562.010323:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789176562.010347:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789176562.010361:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789176562.010374:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789176562.010386:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789176562.010399:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789176562.010412:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789176562.010426:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789176562.010440:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789176562.021427:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789176562.021451:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789176562.021465:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789176562.021490:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789176562.021504:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789176562.021517:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789176562.021573:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176562.021648:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.021694:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176562.023798:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885568 00000100:00100000:0.0:1789176562.023811:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885568 00000100:00100000:0.0:1789176562.023889:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789176562.023900:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176562.024061:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885568:12345-0@lo:502:mount.lustre.0 Request processed in 162us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176562.024078:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789176562.025208:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176562.025428:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789176562.025456:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789176562.025492:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176562.025551:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176562.025584:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176562.026165:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885696 00000100:00100000:2.0:1789176562.026173:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885696 00000100:00100000:2.0:1789176562.026223:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789176562.026231:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176562.026367:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975885696:12345-0@lo:502:mount.lustre.0 Request processed in 136us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.026374:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789176562.026600:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975885696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176562.026658:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789176562.026668:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789176562.028108:0:25052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789176562.028138:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f0ac8d1b380) 00000020:00000080:2.0:1789176562.028162:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789176562.028258:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac77d3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789176562.028262:0:25052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac77d3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789176562.028265:0:25052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac77d3800 3 00010000:00080000:2.0:1789176562.028295:0:25052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac7773800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176562.033706:0:25052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789176562.033963:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789176562.034011:0:25052:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176562.034023:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b53e3d2c055646c 00000100:00080000:2.0:1789176562.034034:0:25052:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176562.034042:0:25052:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac7773800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176562.034084:0:25052:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d58a80 x1876086975885824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176562.034124:0:25052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789176562.034166:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176562.034170:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176562.034172:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176562.034175:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176562.034207:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176562.034210:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789176562.034212:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176562.034216:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 680 00000100:00080000:2.0:1789176562.034219:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789176562.034223:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bc28a9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176562.034234:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723b80 x1876086975886464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176562.034275:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975885952:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975886592:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034419:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789176562.034425:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975886080:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034445:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034464:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975886720:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034482:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034518:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975886208:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034543:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034557:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975886848:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034574:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034592:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176562.034598:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975886336:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034619:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.034648:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885952 00000100:00100000:2.0:1789176562.034654:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885952 00000100:00100000:2.0:1789176562.034690:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886208 00000100:00100000:2.0:1789176562.034693:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886208 00000100:00100000:2.0:1789176562.034709:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789176562.034717:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975885952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034771:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975885952:12345-0@lo:400:kworker.0 Request processed in 54us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.034778:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789176562.034792:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789176562.034798:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975886208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.034871:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975886208:12345-0@lo:400:kworker.0 Request processed in 72us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.037586:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886592 00000100:00100000:3.0:1789176562.037600:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886592 00000100:00100000:3.0:1789176562.037646:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886080 00000100:00100000:3.0:1789176562.037649:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886080 00000100:00100000:3.0:1789176562.037662:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886720 00000100:00100000:3.0:1789176562.037664:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886720 00000100:00100000:3.0:1789176562.037698:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886848 00000100:00100000:3.0:1789176562.037701:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886848 00000100:00100000:3.0:1789176562.037718:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176562.037728:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975886592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176562.037812:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975886592:12345-0@lo:400:kworker.0 Request processed in 86us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.037819:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176562.037854:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789176562.037861:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975886080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176562.037899:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975886080:12345-0@lo:400:kworker.0 Request processed in 39us (3452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.037906:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789176562.037916:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789176562.037922:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975886720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176562.037947:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975886720:12345-0@lo:400:kworker.0 Request processed in 26us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.037953:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789176562.037964:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789176562.037970:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975886848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176562.037996:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975886848:12345-0@lo:400:kworker.0 Request processed in 27us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.038013:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176562.038175:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975885824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176562.038220:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176562.038258:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975886464:0@lo:8:kworker.0 00000100:00100000:1.0:1789176562.038286:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176562.038330:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886336 00000100:00100000:1.0:1789176562.038334:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886336 00000100:00100000:1.0:1789176562.038362:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886464 00000100:00100000:1.0:1789176562.038365:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886464 00000100:00100000:1.0:1789176562.038379:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176562.038387:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975886336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176562.038420:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975886336:12345-0@lo:400:kworker.0 Request processed in 35us (3799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176562.038425:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176562.038437:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176562.038441:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1876086975886464:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789176562.038485:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1876086975886464:12345-0@lo:8:kworker.0 Request processed in 43us (198us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789176562.038491:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176562.038538:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176562.038547:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176562.038551:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789176562.038554:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975886464:0@lo:8:kworker.0 00000100:00080000:0.0:1789176562.039110:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176562.039115:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176562.039117:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:0.0:1789176562.039227:0:25052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789176562.039242:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f0bf720b380) 00000020:00000080:0.0:1789176562.039261:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789176562.039340:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac77d3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789176562.039344:0:25052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac77d3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789176562.039346:0:25052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac77d3800 3 00010000:00080000:0.0:1789176562.039375:0:25052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac8d70000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176562.040991:0:25052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:3.0:1789176562.043950:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975885824 00000100:00100000:3.0:1789176562.043963:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975885824 00000100:00100000:3.0:1789176562.044010:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176562.044018:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975885824:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789176562.044044:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1789176562.044082:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b53e3d2c055647a 00000004:00100000:3.0:1789176562.044097:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789176562.044131:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d8e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176562.044215:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876086975885824:12345-0@lo:38:llog_process_th.0 Request processed in 197us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.044222:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176562.044497:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789176562.044554:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0be7d5a300 x1876086975886080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176562.044569:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975886080:0@lo:400:kworker.0 00010000:00080000:2.0:1789176562.044584:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0beb56e680 x1876086975886720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176562.044606:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975886720:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.044621:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975885952:0@lo:400:kworker.0 00010000:00080000:2.0:1789176562.044631:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0beb56d500 x1876086975886592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176562.044639:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975886592:0@lo:400:kworker.0 00010000:00080000:2.0:1789176562.044678:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac8720e00 x1876086975886336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176562.044686:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975886336:0@lo:400:kworker.0 00000100:00100000:2.0:1789176562.044697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975886208:0@lo:400:kworker.0 00010000:00080000:2.0:1789176562.044707:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0beb56f100 x1876086975886848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176562.044714:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975886848:0@lo:400:kworker.0 00010000:00080000:2.0:1789176562.045044:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0be7d58a80 x1876086975885824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176562.045052:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789176562.045059:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789176562.045066:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789176562.045071:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789176562.045074:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7773800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789176562.045079:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975885824:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1789176562.049017:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789176562.051669:0:25052:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789176562.051687:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4b53e3d2c0556481 00000100:00080000:0.0:1789176562.051699:0:25052:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176562.051705:0:25052:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0ac8d70000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176562.051749:0:25052:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf3090e00 x1876086975886976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176562.051781:0:25052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789176562.052329:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176562.052335:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176562.052338:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176562.052342:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176562.052424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975886976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789176562.052500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789176562.054077:0:25052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1789176562.054530:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975886976 00000100:00100000:3.0:1789176562.054540:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975886976 00000100:00100000:3.0:1789176562.054591:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176562.054599:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975886976:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789176562.054630:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1789176562.054665:0:22714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4b53e3d2c0556488 00000004:00100000:3.0:1789176562.054680:0:22714:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789176562.054710:0:22714:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d8f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176562.054807:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876086975886976:12345-0@lo:38:llog_process_th.0 Request processed in 207us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176562.054814:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789176562.055060:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3090e00 x1876086975886976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176562.055072:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176562.055080:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789176562.055087:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789176562.055092:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789176562.055100:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d70000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789176562.055107:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975886976:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789176562.055329:0:25038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789176562.055367:0:25038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789176562.055389:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055645e expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176562.055400:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a600/0x4b53e3d2c0556457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055645e expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789176562.055449:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789176562.055451:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789176562.055452:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176562.055454:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176562.055455:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176562.055456:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176562.055458:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176562.055459:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176562.055461:0:25038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789176562.055465:0:25038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789176562.055467:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789176562.055468:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789176562.055470:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176562.055471:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176562.055472:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176562.055473:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176562.055474:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176562.055475:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176562.055476:0:25038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789176562.055494:0:25038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789176562.055510:0:25038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975887104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789176562.055557:0:25038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176562.056269:0:25038:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176562.056490:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887104 00000100:00100000:1.0:1789176562.056503:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887104 00000100:00100000:1.0:1789176562.056584:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789176562.056593:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975887104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789176562.056619:0:22709:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789176562.056632:0:22709:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789176562.059804:0:22709:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789176562.059826:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789176562.060373:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789176562.060379:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789176562.060409:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.060432:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 24 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.060452:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.060460:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.060509:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.060525:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 24 pid: 22707 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176562.060544:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975887232:0@lo:104: 00000100:00100000:2.0:1789176562.060625:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176562.060676:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 24 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.060684:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 24 pid: 22708 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176562.060692:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e59180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975887360:0@lo:104: 00000100:00100000:2.0:1789176562.060728:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.060747:0:22730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789176562.061509:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887232 00000100:00100000:2.0:1789176562.061520:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887232 00000100:00100000:2.0:1789176562.061560:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887360 00000100:00100000:2.0:1789176562.061563:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887360 00000100:00100000:2.0:1789176562.061579:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176562.061588:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:22730:x1876086975887232:12345-0@lo:104: 00010000:00010000:2.0:1789176562.061602:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061714:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789176562.061720:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:22730:x1876086975887232:12345-0@lo:104: Request processed in 133us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.061725:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176562.061740:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176562.061744:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975887360:12345-0@lo:104: 00010000:00010000:2.0:1789176562.061752:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061781:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789176562.061785:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:22730:x1876086975887360:12345-0@lo:104: Request processed in 41us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.061791:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789176562.061805:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176562.061810:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061817:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43a800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176562.061860:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061869:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176562.061886:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176562.061892:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789176562.061931:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061938:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176562.061954:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061961:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c055640a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556411 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061971:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176562.061974:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061980:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176562.061983:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.061989:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176562.062005:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176562.062010:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789176562.062022:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062028:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176562.062052:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062058:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05563fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556403 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062070:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176562.062072:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176562.062074:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176562.062093:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975887488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176562.062126:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.062172:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975887616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176562.062193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176562.062226:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887488 00000100:00100000:2.0:1789176562.062229:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887488 00010000:00010000:2.0:1789176562.062258:0:23871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 25 pid: 22707 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176562.062279:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887616 00000100:00100000:2.0:1789176562.062282:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887616 00010000:00010000:2.0:1789176562.062300:0:23871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 26 pid: 22708 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176562.062319:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176562.062325:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de6bc3dc-0fde-4253-a7e7-b570e971a5be+26:3645:x1876086975887488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176562.062336:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176562.062341:0:23871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 26 pid: 22707 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062351:0:23871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 26 pid: 22707 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062368:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176562.062394:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de6bc3dc-0fde-4253-a7e7-b570e971a5be+26:3645:x1876086975887488:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.062400:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176562.062412:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176562.062418:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de6bc3dc-0fde-4253-a7e7-b570e971a5be+25:3642:x1876086975887616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176562.062425:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176562.062429:0:23871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 25 pid: 22708 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062438:0:23871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 25 pid: 22708 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062460:0:23871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062470:0:23871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789176562.062497:0:23871:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011510252s 00010000:00010000:2.0:1789176562.062501:0:23871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062509:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062514:0:23871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062520:0:23871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062525:0:23871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43bc00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176562.062529:0:23871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062535:0:23871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062543:0:23871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176562.062553:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176562.062580:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de6bc3dc-0fde-4253-a7e7-b570e971a5be+25:3642:x1876086975887616:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.062587:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176562.062626:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975887616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176562.062651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975887488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176562.063431:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:25038:x1876086975887104:12345-0@lo:253:mount.lustre.0 Request processed in 6837us (7871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176562.063444:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:1.0:1789176562.063678:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176562.064150:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c0556411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055640a expref: 23 pid: 22707 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176562.064163:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975887232:0@lo:104: 00010000:00010000:0.0:1789176562.064177:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9c600/0x4b53e3d2c0556403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05563fc expref: 22 pid: 22708 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176562.064185:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e59180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1876086975887360:0@lo:104: 00010000:00010000:0.0:1789176562.064207:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176562.064216:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176562.064223:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176562.064229:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bef43bc00/0x4b53e3d2c055648f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176562.064312:0:25038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de6bc3dc-0fde-4253-a7e7-b570e971a5be:25038:1876086975887104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789176562.064325:0:25038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789176562.064329:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176562.064330:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789176562.064332:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176562.064333:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176562.064334:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176562.064335:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176562.064336:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176562.064338:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176562.064339:0:25038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789176562.064351:0:25038:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1789176562.075926:0:25038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789176562.080300:0:25038:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789176562.080310:0:25038:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789176562.080353:0:25038:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789176562.080398:0:25038:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789176562.080412:0:25038:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789176562.080431:0:25038:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789176562.081119:0:25038:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176562.081334:0:25038:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789176562.358265:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176562.907015:0:25106:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176562.907301:0:25106:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789176563.379788:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789176563.890000:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176563.890008:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac599b800 from 14 10000000:01000000:2.0:1789176563.890014:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176563.890060:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176563.890072:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176563.890083:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176563.890111:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975887744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176563.890179:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176563.890221:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd10480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176563.890371:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887744 00000100:00100000:0.0:1789176563.890379:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887744 00000100:00100000:0.0:1789176563.890423:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789176563.890441:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975887744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176563.890454:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176563.890468:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9cc00/0x4b53e3d2c055649d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0556496 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176563.890503:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9cc00/0x4b53e3d2c055649d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0556496 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176563.890512:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9cc00/0x4b53e3d2c055649d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556496 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176563.890521:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:0.0:1789176563.890571:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975887744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176563.890577:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789176563.890716:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975887744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176563.890731:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055649d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176563.890740:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055649d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176563.890791:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975887872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789176563.890823:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176563.890874:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176563.892597:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975887872 00000100:00100000:0.0:1789176563.892612:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975887872 00000100:00100000:0.0:1789176563.892667:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789176563.892676:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975887872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789176563.892701:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789176563.892724:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789176563.892728:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789176563.892886:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975887872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 211us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176563.892895:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789176563.893080:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975887872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789176563.893151:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789176563.893160:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055649d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176563.893171:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bef43a800/0x4b53e3d2c0556496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055649d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176563.893187:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789176563.893190:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bfbff9000 from 14 10000000:01000000:0.0:1789176563.893192:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789176563.893222:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176563.893230:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176563.893238:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176563.893257:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975888000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789176563.893292:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176563.893398:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0168900 going to sleep for 11 seconds 00000100:00100000:3.0:1789176563.895929:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888000 00000100:00100000:3.0:1789176563.895943:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888000 00000100:00100000:3.0:1789176563.896170:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789176563.896180:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975888000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176563.896194:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176563.896213:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a3000/0x4b53e3d2c05564ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05564a4 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176563.896249:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a3000/0x4b53e3d2c05564ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05564a4 expref: 24 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176563.896260:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a3000/0x4b53e3d2c05564ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05564a4 expref: 24 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176563.896269:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3000, rc 0) 00000100:00100000:3.0:1789176563.896343:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975888000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176563.896350:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789176563.896410:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975888000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176563.896545:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05564ab expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176563.896557:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05564ab expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176563.896617:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975888128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789176563.896653:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176563.896689:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac71153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176563.896729:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888128 00000100:00100000:1.0:1789176563.896734:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888128 00000100:00100000:1.0:1789176563.896765:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176563.896771:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975888128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789176563.896784:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176563.896800:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176563.896803:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789176563.896923:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975888128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176563.896931:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176563.897077:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975888128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789176563.897130:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176563.897137:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05564ab expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176563.897145:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05564a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05564ab expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176563.954655:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789176564.275408:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176564.275431:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975888256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176564.275514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176564.275696:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888256 00000100:00100000:3.0:1789176564.275704:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888256 00000100:00100000:3.0:1789176564.275766:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176564.275776:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975888256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176564.275804:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789176564.275889:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975888256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176564.275905:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789176564.275959:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e2680 x1876086975888256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176564.275979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975888256:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789176564.276321:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789176564.402646:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176565.110572:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176545/real 1789176545] req@ffff9f0be7d59c00 x1876086975874304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.110615:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0be7d59c00 x1876086975874304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.110626:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176545/real 1789176545] req@ffff9f0be7d5a680 x1876086975874432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.110638:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0be7d5a680 x1876086975874432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176565.110659:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176565.110724:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789176565.110729:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975874304:0@lo:8:kworker.0 00000100:00080000:1.0:1789176565.110736:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176565.112286:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176565.112291:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789176565.112295:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176565.112302:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 667 00000100:00080000:3.0:1789176565.112308:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789176565.112314:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bfb8c1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176565.112335:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e1880 x1876086975888640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176565.112346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176565.112349:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789176565.112351:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176565.112355:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 667 00000100:00080000:3.0:1789176565.112358:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789176565.112361:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0ac85e7000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176565.112373:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e2d80 x1876086975888768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176565.112449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176565.112452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789176565.112454:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176565.112465:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bc28a9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176565.112481:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e0a80 x1876086975889280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176565.112536:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975888512:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112636:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975889408:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112664:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112686:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975889920:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112711:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112734:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789176565.112740:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975888384:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112767:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112804:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975889152:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112880:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975889792:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112905:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112931:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975888896:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112953:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.112972:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975889536:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.112991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.113001:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789176565.113005:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975889024:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113021:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.113037:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975889664:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113064:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.113090:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888512 00000100:00100000:3.0:1789176565.113097:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888512 00000100:00100000:3.0:1789176565.113136:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889024 00000100:00100000:3.0:1789176565.113139:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889024 00000100:00100000:3.0:1789176565.113156:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176565.113165:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975888512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113219:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975888512:12345-0@lo:400:kworker.0 Request processed in 55us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113226:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176565.113243:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176565.113249:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975889024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113295:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975889024:12345-0@lo:400:kworker.0 Request processed in 46us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113302:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176565.113321:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889408 00000100:00100000:3.0:1789176565.113324:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889408 00000100:00100000:3.0:1789176565.113342:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889920 00000100:00100000:3.0:1789176565.113344:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889920 00000100:00100000:3.0:1789176565.113365:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889792 00000100:00100000:3.0:1789176565.113368:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889792 00000100:00100000:3.0:1789176565.113380:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888896 00000100:00100000:3.0:1789176565.113382:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888896 00000100:00100000:3.0:1789176565.113391:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889536 00000100:00100000:3.0:1789176565.113393:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889536 00000100:00100000:3.0:1789176565.113403:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889664 00000100:00100000:3.0:1789176565.113405:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889664 00000100:00100000:3.0:1789176565.113422:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176565.113429:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113470:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975889408:12345-0@lo:400:kworker.0 Request processed in 42us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113477:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176565.113494:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176565.113500:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975889920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113525:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975889920:12345-0@lo:400:kworker.0 Request processed in 26us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113531:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176565.113541:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176565.113547:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113570:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975889792:12345-0@lo:400:kworker.0 Request processed in 23us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113575:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176565.113585:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176565.113591:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975888896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113611:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975888896:12345-0@lo:400:kworker.0 Request processed in 21us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113617:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176565.113627:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176565.113632:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975889536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113654:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975889536:12345-0@lo:400:kworker.0 Request processed in 22us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113660:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176565.113673:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176565.113679:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975889664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113713:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975889664:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113720:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176565.113742:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888384 00000100:00100000:3.0:1789176565.113747:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888384 00000100:00100000:3.0:1789176565.113773:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789176565.113780:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3645:x1876086975888384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113813:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3645:x1876086975888384:12345-0@lo:400:kworker.0 Request processed in 35us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113820:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789176565.113879:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889152 00000100:00100000:3.0:1789176565.113883:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889152 00000100:00100000:3.0:1789176565.113922:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176565.113931:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975889152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.113967:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975889152:12345-0@lo:400:kworker.0 Request processed in 37us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.113974:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789176565.114009:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176565.114013:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176565.114044:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975889024:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114056:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776e300 x1876086975889664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975889664:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114072:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e0380 x1876086975888896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114091:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975888896:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114100:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e3b80 x1876086975889536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114107:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975889536:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.114139:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975888384:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e1f80 x1876086975889152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114157:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975889152:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114166:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776f480 x1876086975889792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114173:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975889792:0@lo:400:kworker.0 00000100:00100000:3.0:1789176565.114184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975888512:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114193:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e3100 x1876086975889408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114200:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975889408:0@lo:400:kworker.0 00010000:00080000:3.0:1789176565.114209:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776c380 x1876086975889920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176565.114216:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975889920:0@lo:400:kworker.0 00000100:00080000:1.0:1789176565.114724:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789176565.114735:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975874432:0@lo:8:kworker.0 00000100:00100000:1.0:1789176565.114763:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975888640:0@lo:8:kworker.0 00000100:00100000:1.0:1789176565.114805:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176565.114874:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975888768:0@lo:8:kworker.0 00000100:00100000:1.0:1789176565.114898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176565.114922:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888640 00000100:00100000:1.0:1789176565.114928:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888640 00000100:00100000:1.0:1789176565.114950:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975888768 00000100:00100000:1.0:1789176565.114953:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975888768 00000100:00100000:1.0:1789176565.114971:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176565.114978:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975888640:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789176565.115004:0:24222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1789176565.115044:0:24222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05564b2 00002000:00100000:1.0:1789176565.115059:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f0bc7a2a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789176565.115063:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789176565.115066:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789176565.115144:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789176565.115173:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176565.115217:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975888640:12345-0@lo:8:kworker.0 Request processed in 238us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.115225:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176565.115244:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176565.115248:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975888768:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789176565.115263:0:24222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1789176565.115283:0:24222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05564b9 00002000:00100000:1.0:1789176565.115289:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f0bc7a2b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789176565.115293:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789176565.115295:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789176565.115444:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789176565.115459:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a28000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176565.115488:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975888768:12345-0@lo:8:kworker.0 Request processed in 238us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.115495:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789176565.115537:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e2d80 x1876086975888768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.115546:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176565.115552:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789176565.115560:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789176565.115574:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789176565.115576:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789176565.115602:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789176565.115607:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975888768:0@lo:8:kworker.0 00000100:00100000:1.0:1789176565.115615:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975889280:0@lo:8:kworker.0 00000100:00100000:1.0:1789176565.115644:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176565.115666:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975889280 00000100:00100000:1.0:1789176565.115670:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975889280 00000100:00100000:1.0:1789176565.115691:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176565.115695:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975889280:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789176565.115710:0:24222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1789176565.115724:0:24222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05564c0 00002000:00100000:1.0:1789176565.115731:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f0bc7a2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789176565.115734:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789176565.115736:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789176565.115758:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789176565.115770:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176565.115802:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975889280:12345-0@lo:8:kworker.0 Request processed in 99us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.115809:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789176565.115890:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e0a80 x1876086975889280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176565.115901:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789176565.115906:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789176565.115909:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789176565.115911:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc28a9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789176565.115930:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789176565.115935:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975889280:0@lo:8:kworker.0 00010000:00080000:1.0:1789176565.115978:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e1880 x1876086975888640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.115985:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176565.115989:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789176565.115993:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789176565.115996:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789176565.115998:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfb8c1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789176565.116009:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789176565.116013:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975888640:0@lo:8:kworker.0 00000004:00080000:3.0:1789176565.116095:0:23459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789176565.116157:0:23459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 686377325948ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789176565.116169:0:23459:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789176565.116199:0:22739:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789176565.116235:0:22739:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686377403436ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789176565.116238:0:22739:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789176565.116611:0:22742:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789176565.116637:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22742:1876086975890176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789176565.116677:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.116696:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f17d80 going to sleep for 11 seconds 00000004:00080000:0.0:1789176565.116708:0:22741:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789176565.116755:0:22741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686377923537ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789176565.116761:0:22741:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789176565.116807:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176565.116819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975890048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176565.116890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176565.116922:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890176 00000100:00100000:1.0:1789176565.116927:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890176 00000100:00100000:1.0:1789176565.116967:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176565.116975:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22742:x1876086975890176:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789176565.117171:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176565.117337:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890048 00000100:00100000:0.0:1789176565.117342:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890048 00000100:00100000:0.0:1789176565.117387:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176565.117396:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876086975890048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176565.117418:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789176565.117466:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876086975890048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176565.117472:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789176565.117608:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092a00 x1876086975890048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.117628:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975890048:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789176565.117960:0:22740:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1789176565.117976:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22740:1876086975890432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789176565.118009:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.118026:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f17780 going to sleep for 11 seconds 00000004:00080000:0.0:1789176565.118056:0:23460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789176565.118069:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1876086975890688:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789176565.118094:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.118109:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f17600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176565.118121:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975890560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176565.118143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.118168:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890432 00000100:00100000:0.0:1789176565.118174:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890432 00000100:00100000:3.0:1789176565.118195:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176565.118206:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890688 00000100:00100000:3.0:1789176565.118208:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975890304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176565.118211:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890688 00000100:00100000:0.0:1789176565.118233:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176565.118243:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22740:x1876086975890432:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789176565.118251:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176565.119207:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890560 00000100:00100000:1.0:1789176565.119216:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890560 00000100:00100000:1.0:1789176565.119240:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890304 00000100:00100000:1.0:1789176565.119243:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890304 00000100:00100000:1.0:1789176565.119265:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176565.119272:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876086975890560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176565.119291:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176565.119425:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876086975890560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.119432:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176565.119449:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176565.119456:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975890304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176565.119467:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789176565.119504:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975890304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.119509:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789176565.119567:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3091180 x1876086975890560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.119587:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975890560:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789176565.119621:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176565.119625:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789176565.119734:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092300 x1876086975890304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176565.119749:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975890304:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789176565.124507:0:24225:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789176565.124518:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1789176565.124524:0:24225:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000004:00080000:2.0:1789176565.126777:0:23448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789176565.126820:0:24884:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789176565.126845:0:24884:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1789176565.126859:0:24884:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:1.0:1789176565.128536:0:22694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789176565.128620:0:22694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789176565.140193:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.140205:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140222:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.140226:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.140234:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140254:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140265:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140273:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140313:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176565.140328:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.140334:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140342:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.140871:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.140885:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.141415:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.141449:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009772b99/0x4b53e3d2c05564c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.141475:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.141478:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.141481:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.143109:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.143124:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.143140:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.143157:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.143164:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.143177:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.143188:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.143195:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.143223:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.143260:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.143269:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.143285:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.143291:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.143301:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.143320:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.143329:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b250fec/0x4b53e3d2c05564ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.143351:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.143353:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.143355:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.144912:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.144925:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.144940:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.144944:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.144950:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.144963:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.144972:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.144987:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.145015:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.145047:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.145056:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.145066:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.145070:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.145080:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.145103:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.145112:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c05564d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.145131:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.145134:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.145135:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.146515:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.146525:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.146540:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.146544:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.146549:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.146561:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.146571:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.146579:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.146601:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.146625:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.146634:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.146645:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.146649:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.146659:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.146675:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.146684:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076ef084/0x4b53e3d2c05564dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.146720:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.146722:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.146724:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.148100:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.148110:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.148133:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.148137:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.148143:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.148157:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.148167:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.148174:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.148561:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.150479:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.150490:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.150503:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.150509:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.150520:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.150541:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.150549:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba88a3f/0x4b53e3d2c05564e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.150572:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.150575:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.150577:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.150635:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.150643:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.150656:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.150661:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.150668:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.150682:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.150703:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.150712:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.150738:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176565.151790:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.151800:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.151810:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.151814:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.151818:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.151849:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.151867:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.151874:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.151903:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789176565.152461:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176565.152469:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152479:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.152484:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152495:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152514:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152524:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c05564ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152545:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.152548:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152556:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.152559:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152567:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152586:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152595:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc192753/0x4b53e3d2c05564f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152608:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.152611:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.152613:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176565.152672:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.152679:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152689:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.152692:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.152698:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152714:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152724:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152733:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152758:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176565.152766:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.152770:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152778:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ce00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.152781:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152790:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152803:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152811:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c05564f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.152827:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.153111:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.153117:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153126:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.153130:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.153134:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153144:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153153:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153161:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153169:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176565.153592:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.153599:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153608:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.153617:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.153621:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153632:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153641:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153649:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153657:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789176565.153963:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.153969:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153978:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.153981:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.153985:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.153995:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154004:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154017:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154029:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789176565.154358:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.154364:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154373:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.154376:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.154380:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154389:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154397:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154403:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154411:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789176565.154760:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.154766:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154780:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.154783:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.154788:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154798:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154806:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154813:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.154823:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789176565.155158:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.155164:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.155172:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.155175:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.155179:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.155187:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.155209:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.155222:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.155230:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1789176565.155573:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789176565.155581:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155590:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.155595:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155612:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155628:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155636:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9c36f99/0x4b53e3d2c05564ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155655:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789176565.155659:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155664:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.155667:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155674:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155684:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155691:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdcae03/0x4b53e3d2c0556506 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155715:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789176565.155719:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155727:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.155730:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155737:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155747:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155753:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047f3c59f/0x4b53e3d2c055650d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155764:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789176565.155767:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155773:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.155777:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155795:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155807:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155813:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0556514 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155825:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176565.155847:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155863:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.155866:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155873:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155882:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155888:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055651b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155909:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.155912:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155918:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.155921:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.155928:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176565.156124:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.156130:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156140:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.156143:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.156148:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156158:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156166:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156172:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156191:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176565.156576:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.156581:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156591:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.156594:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.156597:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156606:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156613:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156621:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156628:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789176565.156907:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.156913:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.156920:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.156929:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.157050:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157057:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0556522 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157071:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176565.157074:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157081:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.157084:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157103:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157114:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157121:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e509f522/0x4b53e3d2c0556529 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157136:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.157139:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157145:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.157149:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157157:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157166:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157173:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0556530 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.157196:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.157198:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.157200:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.157421:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.157493:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.157500:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.157507:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.157526:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.157701:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.157708:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.157727:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.157730:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176565.158272:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.158280:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.158291:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.158294:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.158300:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.158309:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.158317:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.158332:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.158340:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176565.158717:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1789176565.162295:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.162307:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162323:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.162327:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.162334:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162362:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162373:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162381:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162392:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176565.162941:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.162947:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162963:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.162966:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.162971:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162981:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162990:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.162998:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163007:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789176565.163188:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163207:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163216:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556537 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163237:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176565.163242:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163250:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.163254:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163262:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163274:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163287:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089dc82d0/0x4b53e3d2c0556545 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176565.163290:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.163296:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163302:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.163304:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.163305:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163308:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.163312:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163312:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54bc00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.163316:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163322:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163325:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163335:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163340:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163343:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b44005/0x4b53e3d2c055654c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.163352:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.163354:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.163356:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.163359:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163381:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176565.163718:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.163724:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163731:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.163735:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.163739:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163747:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163754:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163760:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.163777:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789176565.164043:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176565.164049:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164062:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ba00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.164076:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164085:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164096:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164103:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061448afe/0x4b53e3d2c0556553 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164115:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.164119:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164125:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54aa00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.164128:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164135:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164143:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164156:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d11ab5e/0x4b53e3d2c055655a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.164167:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.164169:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.164171:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.164516:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.164522:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.164532:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.164534:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.164538:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.164548:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.164554:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.164561:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.164575:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789176565.165109:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.165117:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165126:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.165129:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.165134:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165144:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165153:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165159:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165167:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789176565.165546:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.165552:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165571:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.165574:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.165578:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165587:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165595:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165602:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.165611:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789176565.166164:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.166172:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.166182:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.166192:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.166197:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.166207:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.166215:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.166223:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.166232:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789176565.166874:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.166882:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.166891:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.166895:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.166900:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.166910:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.166931:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.167666:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.167679:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789176565.168168:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.168176:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.168186:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.168189:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.168194:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.168205:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.168213:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.168227:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.168235:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1789176565.168684:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.168691:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.168700:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.168703:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.168707:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.168717:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.168726:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.168734:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.168754:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1789176565.169386:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.169393:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.169402:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.169405:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.169410:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.169419:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.169437:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.169444:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.169453:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1789176565.169953:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.169960:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.169969:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.169973:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.169977:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.169987:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.169995:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.170002:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.170011:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1789176565.170686:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.170693:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.170704:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.170714:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.170719:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.170730:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.170739:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.170747:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.170756:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1789176565.171190:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.171197:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.171210:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.171213:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.171217:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.171226:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.171233:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.171239:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.171245:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1789176565.172798:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.172812:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.172826:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.172861:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.172868:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.172881:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.172907:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.172916:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.172928:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1789176565.173307:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.173314:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.173323:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.173326:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.173330:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.173340:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.173359:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.173374:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.173383:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1789176565.173728:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.173735:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.173744:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.173747:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.173751:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.173759:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.173767:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.173774:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.173794:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1789176565.174318:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.174325:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.174335:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.174338:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.174343:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.174367:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.174377:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.174385:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.174393:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1789176565.174893:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.174900:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.174910:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.174913:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.174918:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.174928:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.174948:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.174957:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.174965:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1789176565.175250:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.175257:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.175271:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.175274:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.175278:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.175287:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.175295:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.175303:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.175311:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00010000:00010000:2.0:1789176565.175691:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1789176565.175699:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175707:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.175712:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175721:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175737:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175744:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5260025/0x4b53e3d2c0556561 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175765:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1789176565.175770:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175784:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.175788:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175797:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175808:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175815:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047c6da7e/0x4b53e3d2c0556568 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175858:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1789176565.175862:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175868:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.175871:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175878:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175887:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175900:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed233feb/0x4b53e3d2c055656f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175915:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1789176565.175918:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175924:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.175927:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175934:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175945:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175951:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99f4bab/0x4b53e3d2c0556576 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175964:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1789176565.175969:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175975:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.175985:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.175994:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176005:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176012:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4090918/0x4b53e3d2c055657d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176025:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1789176565.176029:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176036:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.176039:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176046:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176055:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176061:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c29179df/0x4b53e3d2c0556584 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176151:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1789176565.176155:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176161:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.176164:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176172:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176183:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176189:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7b5e27f/0x4b53e3d2c055658b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176201:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1789176565.176205:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176211:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.176214:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176232:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176244:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176251:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0556592 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176265:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789176565.176269:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176274:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.176277:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176284:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176292:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.176298:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f1acbf/0x4b53e3d2c0556599 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.176997:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00002000:00010000:0.0:1789176565.177171:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.177180:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.177193:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.177198:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.177204:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177334:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789176565.177339:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177346:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54be00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.177350:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177358:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177373:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177380:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047cbd076/0x4b53e3d2c05565a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177392:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789176565.177395:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177402:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.177405:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177424:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177435:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177444:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d00d60fa/0x4b53e3d2c05565ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177460:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789176565.177464:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177471:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.177474:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177481:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177491:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177499:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad16d972/0x4b53e3d2c05565b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177525:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789176565.177529:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177536:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ac00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.177539:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177547:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177557:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177564:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f209b0a7/0x4b53e3d2c05565bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177577:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789176565.177581:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.177588:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ae00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.177592:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176565.177664:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.177670:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.177679:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.177688:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.177692:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.177701:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.177710:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.177716:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.177725:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789176565.178174:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178188:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178195:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eb1ce16/0x4b53e3d2c05565c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178211:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789176565.178216:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178223:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.178227:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178235:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178245:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178253:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd558551/0x4b53e3d2c05565ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178284:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176565.178288:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178295:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.178298:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178306:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178318:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178324:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fd4a9f/0x4b53e3d2c05565d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178339:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.178343:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178349:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.178352:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178371:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178384:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178392:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b791b5fc/0x4b53e3d2c05565df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.178411:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.178414:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.178416:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.179723:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.179739:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176565.179755:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.179767:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.179786:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.179794:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315e804b/0x4b53e3d2c055653e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.179813:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.179815:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.179817:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.181472:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.181476:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.181478:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.181498:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181512:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.181516:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181527:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181544:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181569:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87d9977/0x4b53e3d2c05565a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181591:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.181593:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.181595:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176565.181769:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.181776:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181788:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.181792:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.181916:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181929:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181938:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181944:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.181962:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176565.182488:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176565.182496:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.182506:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176565.182510:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.182520:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.182547:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.182556:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c05565e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.182572:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.182574:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.182576:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176565.183105:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.183118:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183129:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.183133:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.183139:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183150:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183159:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183167:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183187:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.183196:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.183201:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183209:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43bc00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.183213:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183221:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183241:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183249:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c05565ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183263:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.183265:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.183267:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176565.183762:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.183769:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183777:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.183780:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.183785:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183795:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183810:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183817:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.183878:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176565.184184:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.184210:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.184217:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.184575:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789176565.185007:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176565.185014:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.185024:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.185028:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.185037:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.185052:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.185061:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c05565f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176565.185596:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.185602:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185612:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.185616:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.185622:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185633:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185642:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185650:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185680:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789176565.185690:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176565.185695:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185702:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.185706:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185714:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185727:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185734:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020249d47/0x4b53e3d2c05565d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185749:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.185752:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185758:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.185761:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185780:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185791:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185798:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a8f05f/0x4b53e3d2c05565fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.185814:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.185816:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.185817:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.186369:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.186372:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.186374:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176565.186422:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.186429:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186439:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.186449:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.186454:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186466:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186474:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186481:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186497:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.186505:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.186510:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186517:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.186520:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186527:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186538:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186555:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c0556602 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.186570:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.186572:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.186573:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176565.187129:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.187136:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187146:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.187149:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.187154:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187164:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187172:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187186:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187198:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176565.187207:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.187211:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187219:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.187222:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187230:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187241:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187248:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf18639/0x4b53e3d2c0556609 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.187261:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.187263:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.187265:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.192929:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789176565.194547:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176565.194561:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.194580:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1789176565.194585:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176565.194592:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.194608:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.194619:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.194628:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.194662:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.195058:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.195067:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.195077:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.195082:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.195092:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.195109:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.195118:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c0556610 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.195136:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.195138:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.195140:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.195409:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.195417:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.195426:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.195430:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.195435:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.195445:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.195453:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.195466:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.195522:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789176565.197003:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176565.197013:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.197027:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1789176565.197031:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176565.197037:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.197049:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.197059:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.197067:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176565.197197:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.197204:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.197214:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.197217:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.197221:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.197231:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.197238:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.197245:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.198222:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789176565.198234:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.198245:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.198250:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.198260:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.198278:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.198288:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd49831/0x4b53e3d2c0556617 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199051:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176565.199059:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199067:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.199070:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199078:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199103:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199112:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.199116:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199121:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.199124:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199131:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199139:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.199145:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.199146:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.199149:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.202555:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.202574:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789176565.202585:0:24884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c055661e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.202779:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789176565.202787:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003267c97a/0x4b53e3d2c0556625 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.203617:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176565.204036:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.204046:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.204061:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.204066:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.204072:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.204086:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.204095:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.204103:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.204123:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789176565.204655:0:24225:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1789176565.204743:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22742:x1876086975890176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 87765us (88061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.204752:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176565.204786:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789176565.204797:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23460:x1876086975890688:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789176565.205072:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22742:1876086975890176:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789176565.205089:0:22742:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789176565.205129:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22742:1876086975890816:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789176565.205163:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.205185:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcc910f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789176565.205200:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176565.205208:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.205218:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176565.205222:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.205232:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.205363:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.205371:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b791b5fc/0x4b53e3d2c055662c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.205389:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.205391:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176565.205393:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176565.206667:0:24224:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789176565.206681:0:24224:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:3.0:1789176565.207754:0:24225:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789176565.207762:0:24225:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789176565.207860:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890816 00000100:00100000:0.0:1789176565.207869:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890816 00000100:00100000:3.0:1789176565.207883:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23460:x1876086975890688:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3084us (89782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176565.207895:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176565.207922:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176565.207933:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1876086975890816:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789176565.207959:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1876086975890688:0@lo:7:osp-pre-1-1.0 00002000:00080000:0.0:1789176565.207974:0:24224:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000004:00080000:3.0:1789176565.207977:0:23460:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789176565.208017:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1876086975890944:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789176565.208056:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.208072:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176565.208088:0:24225:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176565.208095:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975890944 00000100:00100000:3.0:1789176565.208099:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975890944 00000100:00100000:1.0:1789176565.209501:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176565.209522:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23460:x1876086975890944:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789176565.209547:0:25231:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789176565.209615:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23460:x1876086975890944:12345-0@lo:5:osp-pre-1-1.0 Request processed in 96us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.209622:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789176565.210067:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1876086975890944:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789176565.210081:0:23460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789176565.210119:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1876086975891072:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789176565.210154:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.210174:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176565.210188:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891072 00000100:00100000:3.0:1789176565.210194:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891072 00000100:00100000:3.0:1789176565.210221:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176565.210227:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23460:x1876086975891072:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789176565.210251:0:24225:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1789176565.211643:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176565.211655:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211680:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789176565.211686:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176565.211693:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211709:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211720:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211728:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211746:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176565.211758:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.211764:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211773:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ae00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.211778:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211787:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211815:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211823:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eb1ce16/0x4b53e3d2c0556633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.211875:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.211878:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.211880:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176565.214594:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.214607:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214622:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.214626:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.214644:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214660:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214671:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214678:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214701:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176565.214715:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176565.214721:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214730:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176565.214734:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214744:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214760:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214780:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8805066/0x4b53e3d2c055663a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.214800:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.214803:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.214804:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176565.218866:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.218883:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.218900:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.218904:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.218911:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.218926:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.218945:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.218953:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.218976:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789176565.219445:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.219459:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.219468:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.219472:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.219476:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.219486:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.219496:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.219503:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.219565:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789176565.219996:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176565.220003:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.220012:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1789176565.220015:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176565.220019:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.220029:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.220044:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176565.220051:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220287:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789176565.220295:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220304:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.220309:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220318:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220335:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220343:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecf71126/0x4b53e3d2c0556641 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220514:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176565.220519:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220526:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43bc00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.220529:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220537:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220546:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220552:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b67a0424/0x4b53e3d2c0556648 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220564:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.220567:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220573:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.220575:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220593:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220602:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.220610:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.220612:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.220614:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789176565.220732:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1789176565.220771:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789176565.220776:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789176565.221029:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22742:x1876086975890816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13095us (15860us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789176565.221040:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176565.221097:0:22742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789176565.221106:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22742:1876086975890816:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789176565.221122:0:22742:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1789176565.221696:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176565.221793:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789176565.221801:0:24884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f385b1/0x4b53e3d2c055664f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176565.223442:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.223452:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223474:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.223480:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.223487:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223503:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223513:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223521:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223547:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176565.223576:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176565.223585:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.223596:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176565.223601:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.223612:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.223632:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.223641:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf18639/0x4b53e3d2c0556656 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.223657:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.223659:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.223662:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.223738:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176565.223923:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.223928:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223959:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.223962:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.223966:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223976:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223984:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.223991:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.224007:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176565.224191:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.224197:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.224205:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.224209:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.224226:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.224238:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.224246:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091a8f05f/0x4b53e3d2c055665d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.224261:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.224263:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.224265:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176565.224661:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.224667:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.224675:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.224678:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.224682:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.224691:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.224710:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.224717:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.224734:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176565.225182:0:25228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176565.225195:0:25228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225206:0:25228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176565.225210:0:25228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225220:0:25228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225234:0:25228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225242:0:25228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020249d47/0x4b53e3d2c0556664 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225259:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.225261:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.225263:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176565.225675:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.225682:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.225691:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.225694:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.225700:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.225709:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.225718:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.225725:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.225754:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176565.225934:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176565.225940:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225948:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176565.225951:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225971:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225984:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.225991:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0170b84/0x4b53e3d2c055666b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.226017:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.226019:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176565.226021:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176565.229714:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176565.229726:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.229743:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1789176565.229748:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176565.229754:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.229769:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.229779:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.229788:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176565.229811:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176565.230124:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.230132:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.230141:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.230176:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.230187:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.230206:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.230226:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d349ae/0x4b53e3d2c0556672 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.230245:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.230248:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.230250:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789176565.230805:0:24884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176565.230814:0:24884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.230826:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1789176565.230867:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176565.230873:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.230886:0:24884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.230895:0:24884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.230910:0:24884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176565.230927:0:24884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789176565.230977:0:24884:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1789176565.231075:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22740:x1876086975890432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112831us (113062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.231085:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176565.231111:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22740:1876086975890432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789176565.231131:0:22740:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1789176565.231175:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22740:1876086975891200:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789176565.231241:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.231281:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccda3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176565.231304:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891200 00000100:00100000:0.0:1789176565.231311:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891200 00000100:00100000:0.0:1789176565.231377:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176565.231386:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22740:x1876086975891200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789176565.231423:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1789176565.231622:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176565.231628:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.231637:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176565.231641:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.231650:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.231665:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.231673:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a695d4/0x4b53e3d2c0556679 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176565.231694:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.231696:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176565.231699:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789176565.245706:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789176565.245747:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789176565.246135:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22740:x1876086975891200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14745us (14889us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789176565.246150:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176565.246203:0:22740:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789176565.246211:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22740:1876086975891200:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789176565.246228:0:22740:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1789176565.255941:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23460:x1876086975891072:12345-0@lo:5:osp-pre-1-1.0 Request processed in 45705us (45779us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789176565.255953:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176565.255972:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1876086975891072:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789176565.255989:0:23460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1789176565.256035:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23460:1876086975891328:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789176565.256070:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176565.256100:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176565.258957:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891328 00000100:00100000:0.0:1789176565.258972:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891328 00000100:00100000:0.0:1789176565.259034:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176565.259043:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23460:x1876086975891328:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789176565.259134:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23460:x1876086975891328:12345-0@lo:900:osp-pre-1-1.0 Request processed in 92us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176565.259142:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789176565.259185:0:23460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac87a8e00 x1876086975891328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176581 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176565.259200:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23460:1876086975891328:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789176565.298758:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975891456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176565.298875:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176565.298955:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975891584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176565.298989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176565.299035:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891456 00000100:00100000:2.0:1789176565.299043:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891456 00000100:00100000:0.0:1789176565.299044:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891584 00000100:00100000:0.0:1789176565.299046:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891584 00000100:00100000:0.0:1789176565.299164:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789176565.299174:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975891584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176565.299209:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789176565.299275:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975891584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176565.299282:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176565.299351:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975891584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176565.300982:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176565.301007:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975891456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176565.301049:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176565.301133:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975891456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176565.301966:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975891456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176565.306202:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1789176565.429453:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789176566.068602:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789176566.450170:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176567.475397:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789176567.587735:0:25399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1789176568.467781:0:25451:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176568.468547:0:25451:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176568.497924:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789176569.324206:0:25501:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176569.324988:0:25501:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176569.400952:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176569.400973:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975891712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176569.401035:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176569.401099:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891712 00000100:00100000:0.0:1789176569.401107:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891712 00000100:00100000:0.0:1789176569.401158:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176569.401167:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975891712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176569.401194:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789176569.401247:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975891712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176569.401254:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789176569.401275:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176569.401369:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975891712:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789176569.522012:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176569.559163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176569.559346:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851136 00000100:00100000:0.0:1789176569.559357:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851136 00000100:00100000:0.0:1789176569.559442:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:0.0:1789176569.559450:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2388:x1876086955851136:12345-192.168.203.30@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789176569.559493:0:22708:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 953e177d-912f-4454-8195-4d36da584e3e@192.168.203.30@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:0.0:1789176569.559523:0:22708:0:(genops.c:1385:class_connect()) connect: client 953e177d-912f-4454-8195-4d36da584e3e, cookie 0x4b53e3d2c0556680 00000100:00080000:0.0:1789176569.559672:0:22708:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d77800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176569.559782:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+5:2388:x1876086955851136:12345-192.168.203.30@tcp:250:mount.lustre.0 Request processed in 330us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176569.559791:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1789176569.566336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.566491:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851264 00000100:00100000:3.0:1789176569.566502:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851264 00000100:00100000:3.0:1789176569.566574:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:3.0:1789176569.566584:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+5:18071:x1876086955851264:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789176569.566601:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176569.566621:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd54b600/0x4b53e3d2c0556687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00fd expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176569.566648:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd54b600/0x4b53e3d2c0556687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00fd expref: 6 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176569.566660:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd54b600/0x4b53e3d2c0556687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00fd expref: 6 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176569.566670:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54b600, rc 0) 00000100:00100000:3.0:1789176569.566816:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+6:18071:x1876086955851264:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 232us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.566887:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1789176569.569271:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176569.569427:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851392 00000100:00100000:0.0:1789176569.569437:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851392 00000100:00100000:0.0:1789176569.569545:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:0.0:1789176569.569557:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+6:18071:x1876086955851392:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789176569.569688:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+6:18071:x1876086955851392:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 133us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789176569.569696:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:2.0:1789176569.573207:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.573302:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851520 00000100:00100000:3.0:1789176569.573311:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851520 00000100:00100000:3.0:1789176569.573369:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:3.0:1789176569.573380:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+6:18071:x1876086955851520:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789176569.573464:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176569.573484:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd54ae00/0x4b53e3d2c055668e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0104 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176569.573514:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd54ae00/0x4b53e3d2c055668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0104 expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176569.573526:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd54ae00/0x4b53e3d2c055668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0104 expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176569.573535:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54ae00, rc 0) 00000100:00100000:3.0:1789176569.573628:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+7:18071:x1876086955851520:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 250us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.573634:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:2.0:1789176569.575889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176569.575982:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851648 00000100:00100000:0.0:1789176569.575992:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851648 00000100:00100000:0.0:1789176569.576043:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:0.0:1789176569.576062:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+7:18071:x1876086955851648:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789176569.576215:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+8:18071:x1876086955851648:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 155us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176569.576223:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:2.0:1789176569.578567:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176569.578659:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851776 00000100:00100000:1.0:1789176569.578667:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851776 00000100:00100000:1.0:1789176569.578719:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:1.0:1789176569.578728:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+8:18071:x1876086955851776:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789176569.579197:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+8:18071:x1876086955851776:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 469us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.579206:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:2.0:1789176569.583132:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.583229:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955851904 00000100:00100000:3.0:1789176569.583238:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955851904 00000100:00100000:3.0:1789176569.583326:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1789176569.583336:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+8:18090:x1876086955851904:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176569.583542:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+8:18090:x1876086955851904:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 207us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.583548:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:2.0:1789176569.606995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176569.607209:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852032 00000100:00100000:1.0:1789176569.607219:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852032 00000100:00100000:1.0:1789176569.607277:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1789176569.607301:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+8:18090:x1876086955852032:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789176569.607640:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+8:18090:x1876086955852032:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 340us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.607649:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:2.0:1789176569.611097:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.611182:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852160 00000100:00100000:3.0:1789176569.611228:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852160 00000100:00100000:3.0:1789176569.611286:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:3.0:1789176569.611295:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+8:18090:x1876086955852160:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176569.611439:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+8:18090:x1876086955852160:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 144us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.611447:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1789176569.615872:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176569.615955:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852288 00000100:00100000:0.0:1789176569.615964:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852288 00000100:00100000:0.0:1789176569.616017:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:0.0:1789176569.616027:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+8:18071:x1876086955852288:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789176569.616043:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176569.616071:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0c020c0a00/0x4b53e3d2c0556695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0135 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176569.616100:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0c020c0a00/0x4b53e3d2c0556695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0135 expref: 9 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176569.616111:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0c020c0a00/0x4b53e3d2c0556695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0135 expref: 9 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176569.616119:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c0a00, rc 0) 00000100:00100000:0.0:1789176569.616175:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+9:18071:x1876086955852288:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176569.616182:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:2.0:1789176569.619008:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176569.619144:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852416 00000100:00100000:1.0:1789176569.619156:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852416 00000100:00100000:1.0:1789176569.619209:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1789176569.619217:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+9:18071:x1876086955852416:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789176569.619238:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789176569.619260:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789176569.619263:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789176569.619266:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789176569.619269:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789176569.619272:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789176569.621016:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+9:18071:x1876086955852416:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 1788us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.621029:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:2.0:1789176569.624626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.625221:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852544 00000100:00100000:3.0:1789176569.625233:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852544 00000100:00100000:2.0:1789176569.625415:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1789176569.625425:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+9:18071:x1876086955852544:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789176569.625439:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176569.625455:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe013c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.625482:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.625492:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.625501:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43b400, rc 0) 00000100:00100000:2.0:1789176569.625564:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+10:18071:x1876086955852544:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 141us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176569.625571:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:0.0:1789176569.627271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176569.627414:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852672 00000100:00100000:1.0:1789176569.627424:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852672 00000100:00100000:1.0:1789176569.627517:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1789176569.627526:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+10:18071:x1876086955852672:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789176569.627666:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+10:18071:x1876086955852672:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 141us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.627674:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:3.0:1789176569.629922:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176569.630079:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852800 00000100:00100000:1.0:1789176569.630101:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852800 00000100:00100000:1.0:1789176569.630151:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:1.0:1789176569.630161:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+10:18071:x1876086955852800:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789176569.630435:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+10:18071:x1876086955852800:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 274us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.630444:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:0.0:1789176569.636655:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176569.637075:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955852928 00000100:00100000:2.0:1789176569.637086:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955852928 00000100:00100000:2.0:1789176569.637250:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:2.0:1789176569.637262:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+10:18094:x1876086955852928:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176569.637420:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+10:18094:x1876086955852928:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 160us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176569.637429:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1789176569.639651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.639751:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853056 00000100:00100000:3.0:1789176569.639760:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853056 00000100:00100000:3.0:1789176569.639809:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:3.0:1789176569.639827:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+10:18094:x1876086955853056:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176569.639990:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+10:18094:x1876086955853056:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 173us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.639998:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:3.0:1789176569.643665:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176569.652527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.654057:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853440 00000100:00100000:0.0:1789176569.654057:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853184 00000100:00100000:3.0:1789176569.654069:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853440 00000100:00100000:0.0:1789176569.654069:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853184 00000100:00100000:3.0:1789176569.654121:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1789176569.654129:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876086955853440:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789176569.654156:0:22715:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2b36a1ad-41a8-406e-85d7-4063c4e2797a@192.168.203.30@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1789176569.654217:0:22715:0:(genops.c:1385:class_connect()) connect: client 2b36a1ad-41a8-406e-85d7-4063c4e2797a, cookie 0x4b53e3d2c05566a3 00000004:00100000:3.0:1789176569.654236:0:22715:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789176569.655254:0:22715:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d8b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176569.655268:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1789176569.655277:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876086955853184:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789176569.655298:0:23785:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2b36a1ad-41a8-406e-85d7-4063c4e2797a@192.168.203.30@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1789176569.655341:0:23785:0:(genops.c:1385:class_connect()) connect: client 2b36a1ad-41a8-406e-85d7-4063c4e2797a, cookie 0x4b53e3d2c05566aa 00000100:00100000:3.0:1789176569.655362:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2388:x1876086955853440:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 1230us (2843us total) trans 0 rc 0/0 00000004:00100000:1.0:1789176569.655363:0:23785:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789176569.655374:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00080000:1.0:1789176569.655521:0:23785:0:(import.c:65:import_set_state_nolock()) ffff9f0bc4230800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176569.655549:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2388:x1876086955853184:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 272us (11894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.655556:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1789176569.657984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176569.658078:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853568 00000100:00100000:2.0:1789176569.658088:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853568 00000100:00100000:2.0:1789176569.658150:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1789176569.658160:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:0:x1876086955853568:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789176569.658194:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176569.658276:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:0:x1876086955853568:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176569.658283:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00080000:0.0:1789176569.658602:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176569.659449:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176569.659485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.659594:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853312 00000100:00100000:3.0:1789176569.659600:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853312 00000100:00100000:3.0:1789176569.659654:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853696 00000100:00100000:3.0:1789176569.659657:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853696 00000100:00100000:3.0:1789176569.659677:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1789176569.659684:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:0:x1876086955853312:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789176569.659718:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789176569.659783:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:0:x1876086955853312:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.659791:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1789176569.659807:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1789176569.659814:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955853696:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789176569.659859:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789176569.659883:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955853696:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.659889:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00080000:0.0:1789176569.660232:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176569.668051:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176569.668158:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853824 00000100:00100000:1.0:1789176569.668168:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853824 00000100:00100000:1.0:1789176569.668219:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1789176569.668228:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955853824:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789176569.668316:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955853824:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176569.668323:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1789176569.671044:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.673196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176569.673245:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176569.673333:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854208 00000100:00100000:2.0:1789176569.673341:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955853952 00000100:00100000:0.0:1789176569.673343:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854208 00000100:00100000:2.0:1789176569.673344:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955853952 00000100:00100000:2.0:1789176569.673377:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854080 00000100:00100000:2.0:1789176569.673379:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854080 00000100:00100000:0.0:1789176569.673382:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1789176569.673402:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1789176569.673409:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876086955853952:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789176569.673441:0:24884:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2b36a1ad-41a8-406e-85d7-4063c4e2797a@192.168.203.30@tcp t0 exp 0000000000000000 cur 690 last 0 00000100:00100000:0.0:1789176569.673441:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955854208:12345-192.168.203.30@tcp:900:mount.lustre.0 00000020:00000080:2.0:1789176569.673471:0:24884:0:(genops.c:1385:class_connect()) connect: client 2b36a1ad-41a8-406e-85d7-4063c4e2797a, cookie 0x4b53e3d2c05566b1 00002000:00100000:2.0:1789176569.673482:0:24884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b36a1ad-41a8-406e-85d7-4063c4e2797a/ffff9f0ac8d0e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789176569.673492:0:24884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789176569.673508:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955854208:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 68us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176569.673514:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00080000:2.0:1789176569.673658:0:24884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789176569.673685:0:24884:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d0b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176569.673737:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2388:x1876086955853952:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 327us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176569.673751:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1789176569.673766:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1789176569.673771:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876086955854080:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789176569.673787:0:24884:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2b36a1ad-41a8-406e-85d7-4063c4e2797a@192.168.203.30@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1789176569.673804:0:24884:0:(genops.c:1385:class_connect()) connect: client 2b36a1ad-41a8-406e-85d7-4063c4e2797a, cookie 0x4b53e3d2c05566b8 00002000:00100000:2.0:1789176569.673810:0:24884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b36a1ad-41a8-406e-85d7-4063c4e2797a/ffff9f0ac8d09800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789176569.673858:0:24884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789176569.673966:0:24884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789176569.673981:0:24884:0:(import.c:65:import_set_state_nolock()) ffff9f0ac8d0f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176569.674010:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2388:x1876086955854080:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 237us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176569.674016:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1789176569.688460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176569.689922:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854336 00000100:00100000:2.0:1789176569.689935:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854336 00000100:00100000:2.0:1789176569.690185:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1789176569.690199:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955854336:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789176569.693455:0:22717:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3164us 00000004:00200000:3.0:1789176569.706086:0:22717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789176569.706235:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18071:x1876086955854336:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 16034us (17778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176569.706249:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1789176569.875620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176569.877384:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854464 00000100:00100000:2.0:1789176569.877401:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854464 00000100:00100000:2.0:1789176569.877486:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1789176569.877496:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18117:x1876086955854464:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1789176569.877515:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176569.877578:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c05566bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe016d expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.877662:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b200/0x4b53e3d2c05566c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.877676:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b200/0x4b53e3d2c05566c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.877690:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b200/0x4b53e3d2c05566c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176569.877733:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176569.877737:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176569.877770:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b200/0x4b53e3d2c05566c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.877912:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c05566bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe016d expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.877936:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b200/0x4b53e3d2c05566c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe016d expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176569.877944:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:2.0:1789176569.877947:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176569.877950:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43b200, rc 0) 00000100:00100000:2.0:1789176569.878025:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18117:x1876086955854464:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 530us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176569.878032:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176570.419909:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975891840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176570.419984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176570.420087:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891840 00000100:00100000:1.0:1789176570.420095:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891840 00000100:00100000:1.0:1789176570.420140:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176570.420150:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975891840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176570.420187:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789176570.420235:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975891840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176570.420243:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176570.420289:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975891840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176570.420442:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176570.420451:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975891968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176570.420499:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176570.420535:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975891968 00000100:00100000:3.0:1789176570.420539:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975891968 00000100:00100000:3.0:1789176570.420580:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176570.420587:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975891968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176570.420600:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789176570.420634:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975891968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176570.420640:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789176570.420659:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176570.420682:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975891968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176570.420922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975892096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176570.420951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176570.420991:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176570.420998:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975892224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176570.421033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176570.421429:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892096 00000100:00100000:3.0:1789176570.421435:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892096 00000100:00100000:3.0:1789176570.421489:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176570.421497:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975892096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176570.421510:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176570.421543:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975892096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176570.421549:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789176570.421643:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176570.421673:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975892096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176570.422137:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892224 00000100:00100000:0.0:1789176570.422148:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892224 00000100:00100000:1.0:1789176570.422154:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176570.422175:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975892352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176570.422226:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176570.422236:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176570.422245:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975892224:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176570.422281:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892352 00000100:00100000:1.0:1789176570.422288:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892352 00000004:00000024:0.0:1789176570.422291:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176570.422336:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176570.422346:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975892352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176570.422380:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975892224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (1343us total) trans 0 rc 0/0 00002000:00000024:1.0:1789176570.422381:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789176570.422400:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176570.422443:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975892352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176570.422452:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789176570.422641:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176570.422680:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975892736:0@lo:400:kworker.0 00000100:00100000:0.0:1789176570.422687:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975892608:0@lo:400:kworker.0 00000100:00100000:3.0:1789176570.422771:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975892864:0@lo:400:kworker.0 00000100:00100000:1.0:1789176570.422803:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975892480:0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.427578:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176570.427641:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975893248:0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.427692:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176570.427759:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893248 00000100:00100000:2.0:1789176570.427768:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893248 00000100:00100000:2.0:1789176570.427965:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789176570.427975:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975893248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.428170:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975893248:12345-0@lo:400:kworker.0 Request processed in 197us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176570.428178:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789176570.428203:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176570.428234:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975893248:0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.428399:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892736 00000100:00100000:2.0:1789176570.428404:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892736 00000100:00100000:2.0:1789176570.428433:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789176570.428440:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975892736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.428620:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975892736:12345-0@lo:400:kworker.0 Request processed in 180us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176570.428626:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789176570.428657:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975892736:0@lo:400:kworker.0 00000100:00100000:0.0:1789176570.430369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176570.430431:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975893120:0@lo:400:kworker.0 00000100:00100000:0.0:1789176570.430475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176570.430572:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975892224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176570.430637:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892608 00000100:00100000:0.0:1789176570.430646:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892608 00000100:00100000:2.0:1789176570.431322:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893120 00000100:00100000:3.0:1789176570.431413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176570.431463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176570.431501:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975892992:0@lo:400:kworker.0 00000100:00100000:1.0:1789176570.431532:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176570.431574:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975892352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176570.431620:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892480 00000100:00100000:1.0:1789176570.431632:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892480 00000100:00100000:3.0:1789176570.431662:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0beb56f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975893376:0@lo:400:kworker.0 00000100:00100000:3.0:1789176570.431695:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176570.431742:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892864 00000100:00100000:3.0:1789176570.431746:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892864 00000100:00100000:1.0:1789176570.431753:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789176570.431766:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3645:x1876086975892480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176570.431771:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975892992 00000100:00100000:3.0:1789176570.431775:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975892992 00000100:00100000:3.0:1789176570.431803:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893376 00000100:00100000:3.0:1789176570.431807:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893376 00000100:00100000:1.0:1789176570.431849:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3645:x1876086975892480:12345-0@lo:400:kworker.0 Request processed in 87us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176570.431858:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789176570.431867:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176570.431877:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975892608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176570.431902:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975892480:0@lo:400:kworker.0 00000100:00100000:3.0:1789176570.431931:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975892608:12345-0@lo:400:kworker.0 Request processed in 55us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176570.431940:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176570.431947:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176570.431957:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975892864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176570.431961:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176570.431973:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975892992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176570.432004:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975892864:12345-0@lo:400:kworker.0 Request processed in 48us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176570.432011:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176570.432024:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975892992:12345-0@lo:400:kworker.0 Request processed in 53us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176570.432031:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176570.432039:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975893376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.432087:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893120 00000100:00100000:3.0:1789176570.432132:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176570.432179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975892864:0@lo:400:kworker.0 00010000:00080000:3.0:1789176570.432199:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0beb56f100 x1876086975893376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176570.432213:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0beb56f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975893376:0@lo:400:kworker.0 00000100:00100000:0.0:1789176570.432239:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975892608:0@lo:400:kworker.0 00000100:00080000:3.0:1789176570.432255:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176570.432267:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176570.432318:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975893376:12345-0@lo:400:kworker.0 Request processed in 279us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176570.435918:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975892992:0@lo:400:kworker.0 00000100:00100000:2.0:1789176570.437225:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789176570.437256:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975893120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176570.437314:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789176570.437398:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975893120:12345-0@lo:400:kworker.0 Request processed in 159us (6920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176570.437408:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789176570.437512:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7e59180 x1876086975893120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176570.437534:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975893120:0@lo:400:kworker.0 00010000:00010000:1.0:1789176570.546740:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789176570.937238:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b36a1ad-41a8-406e-85d7-4063c4e2797a 00000001:00100000:3.0:1789176570.937496:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b36a1ad-41a8-406e-85d7-4063c4e2797a 00000001:00080000:3.0:1789176570.937509:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1789176571.570039:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176571.746024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176571.746654:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854592 00000100:00100000:0.0:1789176571.746687:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854592 00000100:00100000:0.0:1789176571.746793:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1789176571.746814:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18169:x1876086955854592:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1789176571.746913:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789176571.747035:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18169:x1876086955854592:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 231us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176571.747044:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:2.0:1789176571.747724:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176571.750266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.751031:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854720 00000100:00100000:2.0:1789176571.751049:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854720 00000100:00100000:2.0:1789176571.751161:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1789176571.751173:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18169:x1876086955854720:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1789176571.751223:0:22714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176571.751377:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18169:x1876086955854720:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 206us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.751386:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:3.0:1789176571.751543:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176571.757365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.757482:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854848 00000100:00100000:3.0:1789176571.757495:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854848 00000100:00100000:3.0:1789176571.757589:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1789176571.757603:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18169:x1876086955854848:12345-192.168.203.30@tcp:13:lfs.0 00000100:00080000:2.0:1789176571.757605:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789176571.757653:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789176571.757762:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18169:x1876086955854848:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 163us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176571.757771:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1789176571.766998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176571.767147:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955854976 00000100:00100000:0.0:1789176571.767160:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955854976 00000100:00080000:2.0:1789176571.767275:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176571.767665:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176571.767681:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18169:x1876086955854976:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1789176571.767728:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789176571.768173:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18169:x1876086955854976:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 496us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176571.768183:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176571.892314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.892626:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855104 00000100:00100000:2.0:1789176571.892637:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855104 00000100:00100000:2.0:1789176571.892759:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1789176571.892770:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+10:18200:x1876086955855104:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789176571.892787:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176571.892817:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43b800/0x4b53e3d2c05566cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0174 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.892878:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43b800/0x4b53e3d2c05566cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0174 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.892904:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43b800/0x4b53e3d2c05566cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0174 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.892913:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43b800, rc 0) 00000100:00100000:2.0:1789176571.892984:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+11:18200:x1876086955855104:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 204us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.892992:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1789176571.902085:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.902494:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855232 00000100:00100000:3.0:1789176571.902505:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855232 00000100:00100000:3.0:1789176571.902568:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:3.0:1789176571.902579:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+11:18200:x1876086955855232:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789176571.902745:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+11:18200:x1876086955855232:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 168us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176571.902754:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:3.0:1789176571.905357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.905519:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855360 00000100:00100000:2.0:1789176571.905529:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855360 00000100:00100000:2.0:1789176571.905582:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:2.0:1789176571.905592:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+11:18200:x1876086955855360:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789176571.905746:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+11:18200:x1876086955855360:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 154us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.905753:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:0.0:1789176571.917570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176571.917996:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855488 00000100:00100000:1.0:1789176571.918006:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855488 00000100:00100000:1.0:1789176571.918066:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:1.0:1789176571.918076:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+11:18208:x1876086955855488:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789176571.918229:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+11:18208:x1876086955855488:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 154us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176571.918244:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:1.0:1789176571.933265:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.933352:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855616 00000100:00100000:3.0:1789176571.933362:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855616 00000100:00100000:3.0:1789176571.933425:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:3.0:1789176571.933435:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+11:18208:x1876086955855616:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176571.933586:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+11:18208:x1876086955855616:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 152us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176571.933600:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:3.0:1789176571.939752:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.939984:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855744 00000100:00100000:2.0:1789176571.939995:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855744 00000100:00100000:2.0:1789176571.940047:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:2.0:1789176571.940057:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+11:18208:x1876086955855744:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176571.940217:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+11:18208:x1876086955855744:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 160us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.940225:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1789176571.949670:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.949780:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955855872 00000100:00100000:2.0:1789176571.949790:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955855872 00000100:00100000:2.0:1789176571.949914:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:2.0:1789176571.949924:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+11:18200:x1876086955855872:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789176571.949950:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176571.949968:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05566d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01a5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.950145:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05566d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01a5 expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.950157:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43be00/0x4b53e3d2c05566d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01a5 expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.950165:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43be00, rc 0) 00000100:00100000:2.0:1789176571.950222:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+12:18200:x1876086955855872:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 300us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.950229:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:1.0:1789176571.955734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.955874:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856000 00000100:00100000:3.0:1789176571.955884:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856000 00000100:00100000:3.0:1789176571.956185:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:3.0:1789176571.956196:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+12:18200:x1876086955856000:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789176571.956220:0:22708:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789176571.956241:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789176571.956246:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789176571.956249:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789176571.956252:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789176571.956255:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789176571.959240:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+12:18200:x1876086955856000:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 3034us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176571.959255:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:0.0:1789176571.964761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.964864:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856128 00000100:00100000:2.0:1789176571.964874:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856128 00000100:00100000:2.0:1789176571.964936:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1789176571.964948:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+12:18200:x1876086955856128:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789176571.964963:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176571.964992:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01ac expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.965024:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 13 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.965036:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 13 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176571.965063:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43b600, rc 0) 00000100:00100000:2.0:1789176571.965118:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+13:18200:x1876086955856128:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 172us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.965125:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1789176571.967547:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.970035:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856256 00000100:00100000:3.0:1789176571.970050:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856256 00000100:00100000:2.0:1789176571.970263:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:2.0:1789176571.970274:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+13:18200:x1876086955856256:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789176571.970440:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+13:18200:x1876086955856256:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 165us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.970448:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1789176571.972322:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.972539:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856384 00000100:00100000:3.0:1789176571.972551:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856384 00000100:00100000:3.0:1789176571.972639:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:3.0:1789176571.972649:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+13:18200:x1876086955856384:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789176571.972787:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+13:18200:x1876086955856384:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 139us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176571.972795:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:0.0:1789176571.977738:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.977968:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856512 00000100:00100000:2.0:1789176571.977978:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856512 00000100:00100000:2.0:1789176571.978034:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1789176571.978045:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+13:18211:x1876086955856512:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176571.978188:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+13:18211:x1876086955856512:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 144us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176571.978196:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1789176571.984718:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176571.990105:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856640 00000100:00100000:3.0:1789176571.990121:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856640 00000100:00100000:3.0:1789176571.990206:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:3.0:1789176571.990217:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+13:18211:x1876086955856640:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176571.990361:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+13:18211:x1876086955856640:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 146us (5653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176571.990370:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:2.0:1789176571.995266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176571.995310:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176571.997753:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856768 00000100:00100000:1.0:1789176571.997777:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856768 00000100:00100000:1.0:1789176571.998074:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857024 00000100:00100000:1.0:1789176571.998078:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857024 00000100:00100000:1.0:1789176571.998113:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176571.998121:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876086955856768:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789176571.998151:0:23785:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 852aa205-2094-4994-8a68-4550c04d9105@192.168.203.30@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1789176571.998190:0:23785:0:(genops.c:1385:class_connect()) connect: client 852aa205-2094-4994-8a68-4550c04d9105, cookie 0x4b53e3d2c05566e2 00000004:00100000:1.0:1789176571.998217:0:23785:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789176571.998310:0:23785:0:(import.c:65:import_set_state_nolock()) ffff9f0bc4236000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176571.998378:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:2388:x1876086955856768:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 256us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176571.998387:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176571.998404:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1789176571.998408:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876086955857024:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789176571.998422:0:23785:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 852aa205-2094-4994-8a68-4550c04d9105@192.168.203.30@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1789176571.998441:0:23785:0:(genops.c:1385:class_connect()) connect: client 852aa205-2094-4994-8a68-4550c04d9105, cookie 0x4b53e3d2c05566e9 00000004:00100000:1.0:1789176571.998466:0:23785:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789176571.998516:0:23785:0:(import.c:65:import_set_state_nolock()) ffff9f0bc4233000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176571.998555:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:2388:x1876086955857024:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 145us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176571.998563:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1789176572.003788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176572.004046:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857152 00000100:00100000:1.0:1789176572.004057:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857152 00000100:00100000:1.0:1789176572.004178:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1789176572.004188:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:0:x1876086955857152:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789176572.004218:0:23785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176572.004290:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:0:x1876086955857152:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 103us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176572.004298:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00080000:2.0:1789176572.006918:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176572.012595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176572.012692:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176572.012739:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857280 00000100:00100000:3.0:1789176572.012749:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955856896 00000100:00100000:0.0:1789176572.012751:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857280 00000100:00100000:3.0:1789176572.012762:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955856896 00000100:00080000:2.0:1789176572.012948:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176572.013025:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1789176572.013141:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176572.013149:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852aa205-2094-4994-8a68-4550c04d9105+7:18200:x1876086955857280:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176572.013182:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789176572.013326:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852aa205-2094-4994-8a68-4550c04d9105+7:18200:x1876086955857280:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 177us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176572.013344:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176572.015126:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+6:0:x1876086955856896:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789176572.015172:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789176572.015494:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+6:0:x1876086955856896:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 2457us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176572.015503:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1789176572.019753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176572.019885:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857408 00000100:00100000:0.0:1789176572.019895:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857408 00000100:00100000:0.0:1789176572.019949:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176572.019959:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852aa205-2094-4994-8a68-4550c04d9105+6:18200:x1876086955857408:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789176572.020048:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852aa205-2094-4994-8a68-4550c04d9105+6:18200:x1876086955857408:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176572.020055:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176572.023874:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176572.024165:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176572.024210:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176572.024358:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857536 00000100:00100000:1.0:1789176572.024372:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857536 00000100:00100000:1.0:1789176572.024425:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857664 00000100:00100000:1.0:1789176572.024428:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857664 00000100:00100000:1.0:1789176572.024544:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1789176572.024552:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1876086955857536:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789176572.024585:0:25231:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 852aa205-2094-4994-8a68-4550c04d9105@192.168.203.30@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1789176572.024616:0:25231:0:(genops.c:1385:class_connect()) connect: client 852aa205-2094-4994-8a68-4550c04d9105, cookie 0x4b53e3d2c05566f0 00002000:00100000:1.0:1789176572.024627:0:25231:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 852aa205-2094-4994-8a68-4550c04d9105/ffff9f0bc4230000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789176572.024638:0:25231:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789176572.024727:0:25231:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789176572.024761:0:25231:0:(import.c:65:import_set_state_nolock()) ffff9f0bc4233800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176572.024869:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+6:2388:x1876086955857536:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 315us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176572.024877:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1789176572.024907:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1789176572.024912:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1876086955857664:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789176572.024928:0:25231:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 852aa205-2094-4994-8a68-4550c04d9105@192.168.203.30@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1789176572.024955:0:25231:0:(genops.c:1385:class_connect()) connect: client 852aa205-2094-4994-8a68-4550c04d9105, cookie 0x4b53e3d2c05566f7 00002000:00100000:1.0:1789176572.024961:0:25231:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 852aa205-2094-4994-8a68-4550c04d9105/ffff9f0bc4232000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789176572.024968:0:25231:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789176572.025009:0:25231:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1789176572.025018:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857792 00000100:00080000:1.0:1789176572.025025:0:25231:0:(import.c:65:import_set_state_nolock()) ffff9f0bc4232800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176572.025050:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+6:2388:x1876086955857664:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 136us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176572.025058:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1789176572.025093:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857792 00000100:00100000:3.0:1789176572.025160:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1789176572.025169:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:852aa205-2094-4994-8a68-4550c04d9105+6:18200:x1876086955857792:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789176572.025659:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:852aa205-2094-4994-8a68-4550c04d9105+6:18200:x1876086955857792:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 488us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176572.025669:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1789176572.035506:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176572.035978:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955857920 00000100:00100000:1.0:1789176572.035988:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955857920 00000100:00100000:1.0:1789176572.036049:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1789176572.036059:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:852aa205-2094-4994-8a68-4550c04d9105+6:18200:x1876086955857920:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789176572.036154:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789176572.036418:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:852aa205-2094-4994-8a68-4550c04d9105+6:18200:x1876086955857920:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 359us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176572.036428:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1789176572.177418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176572.178167:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858048 00000100:00100000:1.0:1789176572.178177:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858048 00000100:00100000:1.0:1789176572.178252:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176572.178262:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:18234:x1876086955858048:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:1.0:1789176572.178282:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176572.178315:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05566fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01dd expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176572.178639:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176572.178654:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176572.178669:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176572.178709:0:23785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789176572.178713:0:23785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176572.179186:0:23785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176572.179227:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05566fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 8 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176572.179246:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 7 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176572.179255:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:1.0:1789176572.179258:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176572.179261:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2c00, rc 0) 00000100:00100000:1.0:1789176572.179330:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+7:18234:x1876086955858048:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 1068us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176572.179338:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:3.0:1789176572.593982:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176573.174473:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789176573.618166:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176574.518765:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176574.521700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975893504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176574.521773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176574.522048:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893504 00000100:00100000:0.0:1789176574.522057:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893504 00000100:00100000:0.0:1789176574.522113:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176574.522122:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975893504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176574.522152:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789176574.522212:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975893504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176574.522219:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176574.522272:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975893504:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789176574.522512:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789176574.620720:0:25599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789176574.644231:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176575.538369:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176575.538391:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975893632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176575.538450:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176575.538502:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893632 00000100:00100000:3.0:1789176575.538509:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893632 00000100:00100000:3.0:1789176575.538548:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176575.538556:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975893632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176575.538593:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789176575.538634:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975893632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176575.538646:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176575.538688:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975893632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176575.538918:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176575.538926:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975893760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176575.538955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176575.538984:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893760 00000100:00100000:3.0:1789176575.538988:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893760 00000100:00100000:3.0:1789176575.539023:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176575.539030:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975893760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176575.539044:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789176575.539078:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975893760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176575.539085:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789176575.539101:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176575.539127:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975893760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176575.540011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975893888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176575.540055:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.540075:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975894400:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540113:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.540180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975894912:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540204:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.540221:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789176575.540226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975894016:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.540270:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975894528:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.540309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975895040:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540328:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.540356:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894400 00000100:00100000:0.0:1789176575.540361:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894400 00000100:00100000:0.0:1789176575.540393:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176575.540400:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975894400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540439:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975894400:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.540445:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176575.540465:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894912 00000100:00100000:0.0:1789176575.540468:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894912 00000100:00100000:0.0:1789176575.540495:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975895040 00000100:00100000:0.0:1789176575.540498:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975895040 00000100:00100000:0.0:1789176575.540516:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176575.540523:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975894912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540551:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975894912:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.540558:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176575.540576:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789176575.540581:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975895040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540605:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975895040:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.540610:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789176575.540628:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894016 00000100:00100000:0.0:1789176575.540631:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894016 00000100:00100000:0.0:1789176575.540655:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789176575.540661:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3644:x1876086975894016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540689:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3644:x1876086975894016:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.540695:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789176575.540719:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894528 00000100:00100000:0.0:1789176575.540722:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894528 00000100:00100000:0.0:1789176575.540744:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176575.540750:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975894528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540792:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975894528:12345-0@lo:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.540797:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176575.540858:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975894016:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540870:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975894528:0@lo:400:kworker.0 00010000:00080000:0.0:1789176575.540880:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f3100 x1876086975895040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176575.540888:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975895040:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540897:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975894400:0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.540915:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975894912:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543062:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975894144:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543150:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176575.543186:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975894656:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543208:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176575.543231:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975895168:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543262:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176575.543300:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789176575.543309:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975894272:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543355:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176575.543382:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975894784:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176575.543452:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975895296:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543476:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176575.543512:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894144 00000100:00100000:2.0:1789176575.543520:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894144 00000100:00100000:2.0:1789176575.543571:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894656 00000100:00100000:2.0:1789176575.543575:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894656 00000100:00100000:2.0:1789176575.543601:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176575.543625:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975894144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543687:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975894144:12345-0@lo:400:kworker.0 Request processed in 65us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176575.543695:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176575.543715:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176575.543722:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975894656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543749:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975894656:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176575.543755:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176575.543812:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975894144:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.543824:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789176575.543873:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975894656:0@lo:400:kworker.0 00000001:00100000:2.0:1789176575.543934:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 852aa205-2094-4994-8a68-4550c04d9105 00000001:00100000:2.0:1789176575.543943:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2b36a1ad-41a8-406e-85d7-4063c4e2797a 00000100:00100000:0.0:1789176575.544038:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975895168 00000100:00100000:0.0:1789176575.544054:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975895168 00000100:00100000:0.0:1789176575.544100:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894272 00000100:00100000:0.0:1789176575.544103:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894272 00000100:00100000:0.0:1789176575.544114:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975894784 00000100:00100000:0.0:1789176575.544117:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975894784 00000100:00100000:0.0:1789176575.544126:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975895296 00000100:00100000:0.0:1789176575.544129:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975895296 00000100:00100000:0.0:1789176575.544147:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789176575.544156:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975895168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.544251:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975895168:12345-0@lo:400:kworker.0 Request processed in 96us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.544258:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789176575.544275:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176575.544280:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975894272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.544309:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975894272:12345-0@lo:400:kworker.0 Request processed in 29us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.544315:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176575.544325:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789176575.544331:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975894784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.544375:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975894784:12345-0@lo:400:kworker.0 Request processed in 44us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.544382:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789176575.544393:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789176575.544399:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975895296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176575.544434:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975895296:12345-0@lo:400:kworker.0 Request processed in 35us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.544440:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789176575.544495:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176575.544511:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975895424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176575.544546:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176575.544584:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975893888 00000100:00100000:0.0:1789176575.544588:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975893888 00000100:00100000:0.0:1789176575.544607:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975895424 00000100:00100000:0.0:1789176575.544610:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975895424 00000100:00100000:0.0:1789176575.544621:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176575.544626:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975893888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176575.544655:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789176575.544694:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975893888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.544700:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176575.544712:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176575.544718:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975895424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176575.544726:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789176575.544752:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975895424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176575.544757:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176575.544806:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975895424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176575.544896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975893888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176575.545524:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975895552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176575.545566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176575.545621:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975895552 00000100:00100000:3.0:1789176575.545626:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975895552 00000100:00100000:2.0:1789176575.545643:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975894272:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.545667:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975894784:0@lo:400:kworker.0 00000100:00100000:3.0:1789176575.545690:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789176575.545693:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7444380 x1876086975895296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176575.545709:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975895552:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176575.545715:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975895296:0@lo:400:kworker.0 00000100:00100000:2.0:1789176575.545737:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975895168:0@lo:400:kworker.0 00000004:00000024:3.0:1789176575.545749:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789176575.545851:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975895552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176575.545858:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789176575.545879:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176575.545885:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176575.545887:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176575.546571:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975895552:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1789176575.547316:0:22694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 852aa205-2094-4994-8a68-4550c04d9105 00000001:00100000:0.0:1789176575.547333:0:22694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b36a1ad-41a8-406e-85d7-4063c4e2797a 00010000:00010000:3.0:1789176575.666055:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176576.311858:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789176576.690014:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176577.130337:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130399:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130458:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130498:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130520:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130539:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130559:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.130616:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858560 00000100:00100000:0.0:1789176577.130629:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858560 00000100:00100000:0.0:1789176577.130698:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859072 00000100:00100000:0.0:1789176577.130701:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859072 00000100:00100000:0.0:1789176577.130714:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858688 00000100:00100000:0.0:1789176577.130716:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858688 00000100:00100000:0.0:1789176577.130727:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859200 00000100:00100000:0.0:1789176577.130729:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859200 00000100:00100000:0.0:1789176577.130746:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1789176577.130758:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955858560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.130883:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955858560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 127us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.130891:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1789176577.130910:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1789176577.130917:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955859072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.130941:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955859072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.130967:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1789176577.130979:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1789176577.130985:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955858688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131010:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955858688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131016:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1789176577.131027:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176577.131033:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955859200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131055:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955859200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131061:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176577.131080:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858176 00000100:00100000:0.0:1789176577.131084:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858176 00000100:00100000:0.0:1789176577.131112:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:0.0:1789176577.131119:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+13:2389:x1876086955858176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131141:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+13:2389:x1876086955858176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131148:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:0.0:1789176577.131178:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858304 00000100:00100000:0.0:1789176577.131181:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858304 00000100:00100000:0.0:1789176577.131201:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858816 00000100:00100000:0.0:1789176577.131204:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858816 00000100:00100000:0.0:1789176577.131214:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858432 00000100:00100000:0.0:1789176577.131216:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858432 00000100:00100000:0.0:1789176577.131228:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955858944 00000100:00100000:0.0:1789176577.131236:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955858944 00000100:00100000:0.0:1789176577.131253:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1789176577.131259:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2389:x1876086955858304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131289:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2389:x1876086955858304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131294:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1789176577.131305:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1789176577.131311:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955858816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131333:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955858816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131338:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1789176577.131348:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1789176577.131354:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955858432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131375:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955858432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131380:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1789176577.131391:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1789176577.131396:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955858944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176577.131414:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955858944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 18us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.131420:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00080000:3.0:1789176577.131535:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176577.131541:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176577.131544:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176577.131546:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789176577.585415:0:25746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8357c3c0 20000000:00000080:1.0:1789176577.585442:0:25746:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bc41d5c00 uarg=0000000000000000 20000000:01000000:1.0:1789176577.585494:0:25746:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789176577.585502:0:25746:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789176577.585508:0:25746:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789176577.589147:0:25747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 00000001:00100000:0.0:1789176577.590255:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 852aa205-2094-4994-8a68-4550c04d9105 20000000:00000400:3.0:1789176577.590760:0:25746:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00000001:00100000:2.0:1789176577.595002:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 852aa205-2094-4994-8a68-4550c04d9105 10000000:01000000:3.0:1789176577.597024:0:25746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789176577.597067:0:25746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597092:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597101:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597109:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597115:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597126:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597153:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597174:0:25746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597231:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597252:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 12 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.597270:0:25746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975895680:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176577.597413:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597422:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 12 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.597431:0:25746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975895808:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176577.597463:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597472:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 23 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.597482:0:25746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975895936:0@lo:104: 00000100:00100000:3.0:1789176577.597531:0:25746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176577.597597:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.597606:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 23 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.597615:0:25746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975896064:0@lo:104: 00000100:00100000:3.0:1789176577.597637:0:25746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176577.597674:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975895936 00000100:00100000:3.0:1789176577.597683:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975895936 00000100:00100000:3.0:1789176577.597733:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896064 00000100:00100000:3.0:1789176577.597736:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896064 00000100:00100000:3.0:1789176577.597754:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176577.597776:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:25746:x1876086975895936:12345-0@lo:104: 00010000:00010000:3.0:1789176577.597792:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598045:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176577.598053:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+4:25746:x1876086975895936:12345-0@lo:104: Request processed in 290us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176577.598060:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176577.598081:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176577.598087:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:25746:x1876086975896064:12345-0@lo:104: 00010000:00010000:3.0:1789176577.598095:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598130:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789176577.598135:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:25746:x1876086975896064:12345-0@lo:104: Request processed in 48us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176577.598204:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789176577.598244:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598252:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 23 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.598260:0:25746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975896192:0@lo:104: 00000100:00100000:3.0:1789176577.598284:0:25746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176577.598304:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896192 00000100:00100000:3.0:1789176577.598309:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896192 00000100:00100000:3.0:1789176577.598326:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789176577.598394:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:25746:x1876086975896192:12345-0@lo:104: 00010000:00010000:3.0:1789176577.598404:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598438:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789176577.598443:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:25746:x1876086975896192:12345-0@lo:104: Request processed in 111us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176577.598449:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789176577.598467:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789176577.598475:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598483:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176577.598488:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598498:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176577.598513:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176577.598520:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176577.598556:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598563:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176577.598581:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598589:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c0556449 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556450 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598605:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176577.598608:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598612:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176577.598615:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598621:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176577.598628:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176577.598633:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176577.598654:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598660:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176577.598665:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598672:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d600/0x4b53e3d2c05563af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05563b6 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598680:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176577.598683:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598688:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43ae00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176577.598691:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598697:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176577.598703:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176577.598708:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176577.598718:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598723:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176577.598735:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598751:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bef43ae00/0x4b53e3d2c0556370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556377 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.598760:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176577.599012:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176577.599028:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975896320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176577.599065:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176577.599101:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176577.599106:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975896448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176577.599125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176577.599149:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176577.599472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975896576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176577.599503:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176577.599632:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896320 00000100:00100000:2.0:1789176577.599638:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896320 00010000:00010000:2.0:1789176577.599671:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 24 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176577.599695:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896448 00000100:00100000:2.0:1789176577.599698:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896448 00010000:00010000:2.0:1789176577.599712:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 25 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176577.599722:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896576 00000100:00100000:2.0:1789176577.599725:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896576 00010000:00010000:2.0:1789176577.599736:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 26 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176577.599749:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176577.599756:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+26:3642:x1876086975896320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176577.599780:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176577.599785:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 26 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.599810:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 26 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.599918:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176577.599952:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+26:3642:x1876086975896320:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176577.599959:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176577.599979:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176577.599985:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+25:3642:x1876086975896448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176577.599993:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176577.599997:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 25 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.600004:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 25 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.600014:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176577.600036:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+25:3642:x1876086975896448:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176577.600041:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176577.600053:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176577.600059:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3645:x1876086975896576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176577.600065:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176577.600069:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 24 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.600076:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 24 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.600091:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176577.600119:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3645:x1876086975896576:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176577.600125:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789176577.600364:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176577.600482:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975896448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176577.600496:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3642:1876086975896320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176577.600527:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3645:1876086975896576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176577.603774:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176577.603789:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176577.603916:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.603938:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 23 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.603957:0:25746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975896704:0@lo:104: 00000100:00100000:3.0:1789176577.604047:0:25746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176577.604095:0:25746:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115180 going to sleep for 11 seconds 00010000:00010000:3.0:1789176577.604128:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bef43a400/0x4b53e3d2c0556450 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0556449 expref: 23 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.604147:0:25746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975895936:0@lo:104: 00000100:00100000:2.0:1789176577.604390:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896704 00000100:00100000:2.0:1789176577.604399:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896704 00000100:00100000:2.0:1789176577.604458:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176577.604470:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:25746:x1876086975896704:12345-0@lo:104: 00010000:00010000:2.0:1789176577.604487:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176577.605186:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05563b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05563af expref: 22 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.605202:0:25746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975896064:0@lo:104: 00000100:00100000:0.0:1789176577.605450:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.605519:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176577.605549:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859456 00000100:00100000:0.0:1789176577.605554:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859456 00010000:00010000:0.0:1789176577.605586:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 13 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176577.605611:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859328 00000100:00100000:0.0:1789176577.605614:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859328 00010000:00010000:0.0:1789176577.605625:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 14 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176577.605643:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1789176577.605650:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:953e177d-912f-4454-8195-4d36da584e3e+14:2390:x1876086955859456:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176577.605664:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176577.605671:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 14 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.605682:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 14 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.605706:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176577.605771:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:953e177d-912f-4454-8195-4d36da584e3e+14:2390:x1876086955859456:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.605779:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1789176577.605796:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1789176577.605803:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7487450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:953e177d-912f-4454-8195-4d36da584e3e+13:2390:x1876086955859328:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176577.605810:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176577.605814:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 13 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.605850:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 13 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.606094:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176577.606116:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7487450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:953e177d-912f-4454-8195-4d36da584e3e+13:2390:x1876086955859328:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 313us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176577.606122:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:2.0:1789176577.606347:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789176577.606356:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+3:25746:x1876086975896704:12345-0@lo:104: Request processed in 1888us (2309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176577.606365:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789176577.606486:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176577.606495:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.606504:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176577.606508:0:25227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.606519:0:25227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176577.606527:0:25227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176577.606533:0:25227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176577.606586:0:25227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.606594:0:25227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176577.606626:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.606647:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0556362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0556369 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176577.606667:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176577.606669:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176577.606671:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176577.606681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176577.606698:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975896832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176577.606744:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176577.607289:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975896832 00000100:00100000:1.0:1789176577.607299:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975896832 00010000:00010000:1.0:1789176577.607402:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 22 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176577.607441:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176577.607451:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:3644:x1876086975896832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176577.607465:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176577.607470:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 22 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607482:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 22 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607501:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607510:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607530:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607538:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607561:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607569:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607575:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ac00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176577.607580:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607589:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607599:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176577.607610:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176577.607667:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:3644:x1876086975896832:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176577.607675:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176577.607721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975896832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176577.609791:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c0556377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0556370 expref: 21 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176577.609816:0:25746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975896192:0@lo:104: 00010000:00010000:2.0:1789176577.610084:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9de00/0x4b53e3d2c0556369 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0556362 expref: 20 pid: 22708 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176577.610095:0:25746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975896704:0@lo:104: 00010000:00010000:2.0:1789176577.610114:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bef43b600/0x4b53e3d2c05566db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01ac expref: 12 pid: 22709 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176577.610151:0:25746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975895680:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176577.610241:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bef43b400/0x4b53e3d2c055669c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe013c expref: 11 pid: 22707 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176577.610252:0:25746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1876086975895808:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176577.610290:0:25746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.610302:0:25746:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.610308:0:25746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.610315:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd54ac00/0x4b53e3d2c055670c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176577.715422:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176578.738199:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176578.905500:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176578.905624:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859584 00000100:00100000:0.0:1789176578.905645:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859584 00000100:00100000:0.0:1789176578.905959:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1789176578.905975:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:18702:x1876086955859584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176578.906001:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176578.906032:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0c00/0x4b53e3d2c0556713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906120:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906138:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906157:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906176:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906217:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906226:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906334:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1a00/0x4b53e3d2c0556728 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906343:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1a00/0x4b53e3d2c0556728 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906349:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1a00/0x4b53e3d2c0556728 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176578.906385:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176578.906389:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176578.906438:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1a00/0x4b53e3d2c0556728 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906450:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906458:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906466:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906472:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176578.906478:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906493:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906508:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:0.0:1789176578.906512:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176578.906517:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906524:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c055671a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906543:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906551:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906557:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906563:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176578.906566:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906574:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906582:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f0ac189c200) 00010000:00010000:0.0:1789176578.906584:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176578.906588:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906604:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556721 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906644:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0c00/0x4b53e3d2c0556713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01e4 expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906659:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1a00/0x4b53e3d2c0556728 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01e4 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.906666:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0ac189cc00) 00010000:00010000:0.0:1789176578.906668:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176578.906671:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c1a00, rc 0) 00000100:00100000:0.0:1789176578.906951:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18702:x1876086955859584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 979us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176578.906961:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1789176578.910039:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176578.910130:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859712 00000100:00100000:3.0:1789176578.910154:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859712 00000100:00100000:3.0:1789176578.910257:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1789176578.910269:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18702:x1876086955859712:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789176578.910474:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18702:x1876086955859712:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 206us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176578.910482:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1789176578.915254:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176578.915343:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955859968 00000100:00100000:3.0:1789176578.915351:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955859968 00000100:00100000:3.0:1789176578.915450:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1789176578.915461:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18702:x1876086955859968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176578.915480:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176578.915502:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c055672f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01eb expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915571:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915585:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915596:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915610:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915617:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915623:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915732:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a400/0x4b53e3d2c0556744 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915740:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a400/0x4b53e3d2c0556744 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.915747:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a400/0x4b53e3d2c0556744 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176578.915973:0:23785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789176578.916116:0:23785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916123:0:23785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916130:0:23785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916136:0:23785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54be00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176578.916140:0:23785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916147:0:23785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916158:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0ac189cc00) 00010000:00010000:3.0:1789176578.916162:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176578.916166:0:23785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916182:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c0556736 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916194:0:23785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916200:0:23785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916205:0:23785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916209:0:23785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176578.916211:0:23785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916217:0:23785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916224:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176578.916226:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176578.916229:0:23785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.916234:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c055673d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.917038:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c055672f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01eb expref: 10 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.917070:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a400/0x4b53e3d2c0556744 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01eb expref: 9 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.917079:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10bcc00) 00010000:00010000:3.0:1789176578.917081:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176578.917084:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a400, rc 0) 00000100:00100000:3.0:1789176578.917193:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18702:x1876086955859968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1733us (1946us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789176578.917202:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1789176578.921388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176578.921487:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860096 00000100:00100000:0.0:1789176578.921497:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860096 00000100:00100000:0.0:1789176578.921561:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1789176578.921572:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18702:x1876086955860096:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789176578.921725:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18702:x1876086955860096:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 154us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176578.921733:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1789176578.928004:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176578.928084:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860224 00000100:00100000:1.0:1789176578.928094:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860224 00000100:00100000:1.0:1789176578.928148:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1789176578.928159:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18702:x1876086955860224:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789176578.930141:0:22716:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1939us 00000100:00100000:3.0:1789176578.950962:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18702:x1876086955860224:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 22796us (22958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176578.950977:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1789176578.961609:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176578.962009:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860352 00000100:00100000:0.0:1789176578.962019:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860352 00000100:00100000:0.0:1789176578.962086:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1789176578.962110:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18708:x1876086955860352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176578.962130:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176578.962150:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01f2 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962214:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962228:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962239:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962292:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962299:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962306:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962361:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962368:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962375:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962391:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176578.962406:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962414:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962427:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:0.0:1789176578.962430:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176578.962434:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962440:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962454:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962460:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962471:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962475:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176578.962478:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962484:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962503:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0ac189c200) 00010000:00010000:0.0:1789176578.962505:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176578.962508:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962514:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1c00/0x4b53e3d2c0556760 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962549:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556752 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01f2 expref: 10 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962559:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:0.0:1789176578.962560:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176578.962564:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0000/0x4b53e3d2c0556752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01f2 expref: 10 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.962572:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c0000, rc 0) 00000100:00100000:0.0:1789176578.962637:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18708:x1876086955860352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 530us (1037us total) trans 0 rc 301/301 00000100:00100000:0.0:1789176578.962644:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1789176578.969064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176578.969554:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860480 00000100:00100000:3.0:1789176578.969563:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860480 00000100:00100000:3.0:1789176578.969645:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176578.969656:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18708:x1876086955860480:12345-192.168.203.30@tcp:700:lfs.0 00000100:00100000:3.0:1789176578.969739:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18708:x1876086955860480:12345-192.168.203.30@tcp:700:lfs.0 Request processed in 85us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176578.969747:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1789176578.971422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176578.971492:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860736 00000100:00100000:3.0:1789176578.971500:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860736 00000100:00100000:3.0:1789176578.971548:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:3.0:1789176578.971556:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:18708:x1876086955860736:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1789176578.971613:0:23785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176578.971639:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b200/0x4b53e3d2c05566c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe016d expref: 9 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.971658:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:3.0:1789176578.971663:0:23785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176578.971723:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.971736:0:23785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 5 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.971744:0:23785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.971789:0:23785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 5 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176578.971918:0:23785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 5 pid: 23785 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176578.971933:0:23785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23785:1876086975896960:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176578.972113:0:23785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176578.975234:0:23785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23785:1876086975896960:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176578.975264:0:23785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176578.975738:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176578.975823:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860864 00000100:00100000:0.0:1789176578.975878:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860864 00010000:00010000:0.0:1789176578.975996:0:23871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 6 pid: 23785 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176578.976040:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1789176578.976050:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955860864:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176578.976064:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176578.976071:0:23871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 6 pid: 23785 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.976094:0:23871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 6 pid: 23785 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.976117:0:23871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556705 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01dd expref: 6 pid: 23785 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.976132:0:23871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:0.0:1789176578.976136:0:23871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.976146:0:23871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.976153:0:23871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176578.976178:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176578.976231:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955860864:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 182us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176578.976246:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00010000:00010000:1.0:1789176578.976494:0:23785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.976503:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.976524:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.976534:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.976543:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.980308:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.980342:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.980361:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176578.980380:0:23785:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d034a0d reply state 00000000c058827c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.980391:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981510:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:1.0:1789176578.981514:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176578.981531:0:23785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789176578.981537:0:23785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789176578.981549:0:23785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981559:0:23785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981566:0:23785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981573:0:23785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176578.981578:0:23785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981586:0:23785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981597:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436800) 00010000:00010000:1.0:1789176578.981600:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176578.981604:0:23785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981611:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556767 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176578.981631:0:23785:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d034a0d reply state 00000000c058827c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981642:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176578.981649:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0bfd4f8c00) 00010000:00010000:1.0:1789176578.981656:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176578.981658:0:23785:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789176578.981816:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+10:18708:x1876086955860736:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 10255us (10396us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789176578.981825:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 10000000:01000000:0.0:1789176579.058012:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789176579.058022:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac77d3800 from 13 10000000:01000000:0.0:1789176579.058028:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176579.058083:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.058095:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.058105:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176579.058131:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789176579.058202:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176579.058309:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789176579.060096:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897088 00000100:00100000:3.0:1789176579.060109:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897088 00000100:00100000:1.0:1789176579.060818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176579.061133:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955860992 00000100:00100000:0.0:1789176579.061140:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955860992 00000100:00100000:0.0:1789176579.061212:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1789176579.061227:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+10:18716:x1876086955860992:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:0.0:1789176579.061252:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176579.061278:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe01f9 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789176579.061458:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789176579.061581:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1400/0x4b53e3d2c055678a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.061597:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1400/0x4b53e3d2c055678a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.061626:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1400/0x4b53e3d2c055678a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176579.061684:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176579.061689:0:22715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176579.061728:0:22715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1400/0x4b53e3d2c055678a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.061763:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c0600/0x4b53e3d2c0556783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01f9 expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.061782:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0c020c1400/0x4b53e3d2c055678a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe01f9 expref: 11 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.061790:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:0.0:1789176579.061793:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176579.061797:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c1400, rc 0) 00000100:00100000:0.0:1789176579.062037:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+11:18716:x1876086955860992:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 815us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.062044:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1789176579.065678:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789176579.065693:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+20:22711:x1876086975897088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176579.065710:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176579.065731:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc0030800/0x4b53e3d2c0556791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055677c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.065791:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc0030800/0x4b53e3d2c0556791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055677c expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.065802:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc0030800/0x4b53e3d2c0556791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055677c expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.065812:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0030800, rc 0) 00000100:00100000:2.0:1789176579.067352:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975897088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1656us (9144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.067363:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789176579.067461:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176579.067483:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556791 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.067495:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0556791 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176579.067585:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7444380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176579.067634:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176579.067905:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789176579.072426:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897216 00000100:00100000:1.0:1789176579.072441:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897216 00000100:00100000:1.0:1789176579.072556:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789176579.072567:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975897216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176579.072770:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975897216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (5134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176579.072779:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789176579.072886:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7444380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.072939:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.074270:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176579.081311:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897344 00000100:00100000:0.0:1789176579.081336:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897344 00000100:00100000:0.0:1789176579.081393:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789176579.081403:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975897344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176579.081568:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975897344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (7300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.081575:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789176579.081787:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176579.081812:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176579.084043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.084077:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955861120 00000100:00100000:3.0:1789176579.084086:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955861120 00000100:00100000:3.0:1789176579.084143:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1789176579.084166:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+5:18717:x1876086955861120:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176579.084188:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.084208:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0200 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.084463:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c055679f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.084477:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c055679f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.084488:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c055679f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176579.084530:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176579.084534:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176579.084572:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c055679f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.084596:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0200 expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.084615:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54be00/0x4b53e3d2c055679f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0200 expref: 6 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.084625:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:3.0:1789176579.084628:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176579.084632:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54be00, rc 0) 00000100:00100000:3.0:1789176579.084764:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+6:18717:x1876086955861120:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 600us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.084781:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00080000:3.0:1789176579.084812:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789176579.085514:0:25761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789176579.085882:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789176579.085906:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176579.085917:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556791 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.085929:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1c00/0x4b53e3d2c055677c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0556791 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176579.085940:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176579.085943:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac7f8b000 from 13 10000000:01000000:2.0:1789176579.085946:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176579.085988:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.085996:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.086005:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.086027:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.086079:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176579.086225:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176579.089972:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897472 00000100:00100000:0.0:1789176579.089987:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897472 00000100:00100000:0.0:1789176579.090046:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789176579.090058:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+21:22711:x1876086975897472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176579.090073:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176579.090094:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0c020c0600/0x4b53e3d2c05567ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05567a6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.090124:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0c020c0600/0x4b53e3d2c05567ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05567a6 expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.090272:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0c020c0600/0x4b53e3d2c05567ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05567a6 expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.090282:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c0600, rc 0) 00000100:00100000:0.0:1789176579.090359:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975897472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (4279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.090367:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789176579.090600:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.090622:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567ad expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.090631:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05567ad expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176579.090704:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176579.090740:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176579.090787:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176579.090893:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.091022:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955861248 00000100:00100000:3.0:1789176579.091027:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955861248 00000100:00100000:3.0:1789176579.091099:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1789176579.091107:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+6:18717:x1876086955861248:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176579.091119:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.091133:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05567b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0207 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091183:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091195:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091205:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091229:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091232:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897600 00000100:00100000:2.0:1789176579.091238:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897600 00010000:00010000:3.0:1789176579.091242:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091251:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091267:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789176579.091277:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975897600:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.091343:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05567c9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091353:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05567c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091362:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05567c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091378:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975897600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.091386:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000004:00200000:3.0:1789176579.091395:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176579.091400:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176579.091419:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05567c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091423:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897600:0@lo:501:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.091436:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091444:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091451:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091464:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897728:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.091477:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176579.091482:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091491:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091505:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:3.0:1789176579.091510:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176579.091511:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176579.091515:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091524:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c05567bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091538:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00010000:00010000:3.0:1789176579.091539:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091549:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091553:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897728 00010000:00010000:3.0:1789176579.091558:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091559:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897728 00010000:00010000:3.0:1789176579.091567:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176579.091572:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091580:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.091580:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789176579.091591:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975897728:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.091607:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0bfd4f8c00) 00010000:00010000:3.0:1789176579.091614:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176579.091617:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091624:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05567c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091650:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05567b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0207 expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091664:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05567c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0207 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.091672:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:3.0:1789176579.091675:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176579.091677:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54b800, rc 0) 00000100:00100000:2.0:1789176579.091689:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975897728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.091696:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789176579.091718:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+7:18717:x1876086955861248:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 611us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.091726:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1789176579.091745:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789176579.093576:0:25762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:3.0:1789176579.094405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176579.095251:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955861376 00000100:00100000:0.0:1789176579.095275:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955861376 00000100:00100000:0.0:1789176579.095348:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1789176579.095359:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:852aa205-2094-4994-8a68-4550c04d9105+5:18717:x1876086955861376:12345-192.168.203.30@tcp:900:lfs.0 00000100:00080000:3.0:1789176579.095393:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176579.095440:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:852aa205-2094-4994-8a68-4550c04d9105+5:18717:x1876086955861376:12345-192.168.203.30@tcp:900:lfs.0 Request processed in 83us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.095447:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000020:01000000:2.0:1789176579.099388:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789176579.099428:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176579.099440:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567ad expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.099451:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031400/0x4b53e3d2c05567a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567ad expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176579.099463:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176579.099466:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b800 from 13 10000000:01000000:2.0:1789176579.099469:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176579.099512:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.099521:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.099531:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.099557:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.099628:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176579.099652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176579.099715:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176579.101172:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955861632 00000100:00100000:1.0:1789176579.101184:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955861632 00000100:00100000:1.0:1789176579.101252:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:1.0:1789176579.101263:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+7:18717:x1876086955861632:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176579.101279:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176579.101300:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05567d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe020e expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176579.101392:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789176579.101496:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05567d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe020e expref: 9 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.101529:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:1.0:1789176579.101532:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789176579.101538:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05567d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe020e expref: 9 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.101553:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3800, rc 0) 00000100:00100000:1.0:1789176579.101614:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+8:18717:x1876086955861632:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 353us (1964us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1789176579.101621:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1789176579.105076:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.105124:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955861888 00000100:00100000:1.0:1789176579.105146:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955861888 00000100:00100000:1.0:1789176579.105207:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1789176579.105217:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852aa205-2094-4994-8a68-4550c04d9105+8:18717:x1876086955861888:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:1.0:1789176579.105270:0:22715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176579.105295:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05567c9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0207 expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.105315:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:1.0:1789176579.105321:0:22715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176579.105343:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.105357:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.105366:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176579.105551:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bd8e62b reply state 00000000a2c4f4a0 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.105565:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.105572:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:1.0:1789176579.105574:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789176579.105577:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789176579.105584:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789176579.105665:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852aa205-2094-4994-8a68-4550c04d9105+9:18717:x1876086955861888:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 448us (595us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789176579.105673:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1789176579.107038:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897856 00000100:00100000:0.0:1789176579.107053:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897856 00000100:00100000:0.0:1789176579.107113:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176579.107124:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+22:22711:x1876086975897856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176579.107208:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176579.107226:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0c020c1200/0x4b53e3d2c05567ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05567d0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.107252:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0c020c1200/0x4b53e3d2c05567ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05567d0 expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.107263:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0c020c1200/0x4b53e3d2c05567ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05567d0 expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.107271:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c1200, rc 0) 00000100:00100000:0.0:1789176579.107329:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975897856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (7701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.107336:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789176579.107390:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176579.107425:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567ec expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.107436:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05567ec expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.107521:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.107561:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176579.107612:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176579.107647:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975897984 00000100:00100000:0.0:1789176579.107652:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975897984 00000100:00100000:0.0:1789176579.107954:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789176579.107963:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975897984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176579.108090:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975897984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.108097:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789176579.110358:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975897984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.110421:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.110489:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176579.110528:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176579.110546:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975898112 00000100:00100000:2.0:1789176579.110552:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975898112 00000100:00100000:2.0:1789176579.110587:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789176579.110596:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975898112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.110697:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975898112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.110705:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789176579.110749:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789176579.112094:0:25763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789176579.112744:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789176579.112784:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176579.112795:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567ec expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.112822:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc0030e00/0x4b53e3d2c05567d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567ec expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176579.112947:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 10000000:01000000:2.0:1789176579.113011:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176579.113015:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfbff9000 from 13 10000000:01000000:2.0:1789176579.113018:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176579.113050:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.113058:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.113068:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.113090:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.113134:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176579.113204:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176579.113247:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975898240 00000100:00100000:3.0:1789176579.113254:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975898240 00000100:00100000:3.0:1789176579.113452:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789176579.113462:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+23:22711:x1876086975898240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.113474:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.113486:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd54aa00/0x4b53e3d2c05567fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05567f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.113508:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd54aa00/0x4b53e3d2c05567fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05567f3 expref: 24 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.113518:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd54aa00/0x4b53e3d2c05567fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05567f3 expref: 24 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.113526:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54aa00, rc 0) 00000100:00100000:3.0:1789176579.113564:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975898240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.113570:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789176579.113638:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176579.113651:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567fa expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.113660:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05567fa expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.113715:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.113739:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176579.113800:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176579.113885:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975898368 00000100:00100000:3.0:1789176579.113890:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975898368 00000100:00100000:3.0:1789176579.113951:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789176579.113959:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975898368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176579.114064:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975898368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.114071:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789176579.114116:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.114143:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.114179:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176579.114218:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975898496 00000100:00100000:2.0:1789176579.114222:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176579.114224:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975898496 00000100:00100000:3.0:1789176579.114260:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789176579.114269:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975898496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176579.114317:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955862144 00000100:00100000:1.0:1789176579.114322:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955862144 00000100:00100000:1.0:1789176579.114363:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1789176579.114371:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:852aa205-2094-4994-8a68-4550c04d9105+9:18717:x1876086955862144:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176579.114551:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:852aa205-2094-4994-8a68-4550c04d9105+10:18717:x1876086955862144:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 180us (1607us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789176579.114558:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1789176579.115864:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:22711:x1876086975898496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1581us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.115889:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789176579.116071:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de6bc3dc-0fde-4253-a7e7-b570e971a5be:22711:1876086975898496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789176579.117388:0:25764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789176579.117635:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789176579.117662:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176579.117673:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567fa expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.117685:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc0031200/0x4b53e3d2c05567f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05567fa expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176579.119552:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.120854:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955862400 00000100:00100000:1.0:1789176579.120877:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955862400 00000100:00100000:1.0:1789176579.120942:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1789176579.120953:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+10:18717:x1876086955862400:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176579.120977:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176579.121001:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0215 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121088:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121103:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121114:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121125:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121474:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121487:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176579.121586:0:23785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789176579.121654:0:23785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121662:0:23785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121668:0:23785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121673:0:23785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176579.121677:0:23785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121695:0:23785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121708:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:1.0:1789176579.121711:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176579.121716:0:23785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121722:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121737:0:23785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121743:0:23785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121750:0:23785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121765:0:23785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176579.121768:0:23785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121774:0:23785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121782:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0bfd4f8c00) 00010000:00010000:1.0:1789176579.121784:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176579.121787:0:23785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121803:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055680f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.121862:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556801 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0215 expref: 12 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.122261:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:1.0:1789176579.122263:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789176579.122268:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0215 expref: 12 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.122280:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2c00, rc 0) 00000100:00100000:1.0:1789176579.122354:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+11:18717:x1876086955862400:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1403us (2811us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1789176579.122361:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1789176579.128671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.132042:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955862528 00000100:00100000:3.0:1789176579.132058:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955862528 00000100:00100000:3.0:1789176579.132126:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1789176579.132137:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+11:18717:x1876086955862528:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176579.132163:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.132186:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055681d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe021c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.132289:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.133613:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.133635:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176579.133679:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176579.133683:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176579.133703:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.133741:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055681d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 13 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.133771:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.133801:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:3.0:1789176579.133804:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176579.133808:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54b000, rc 0) 00000100:00100000:3.0:1789176579.134104:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852aa205-2094-4994-8a68-4550c04d9105+12:18717:x1876086955862528:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1967us (5440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.134113:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1789176579.144716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176579.144821:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955862656 00000100:00100000:2.0:1789176579.144869:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955862656 00000100:00100000:2.0:1789176579.144921:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1789176579.144931:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:852aa205-2094-4994-8a68-4550c04d9105+12:18717:x1876086955862656:12345-192.168.203.30@tcp:37:lfs.0 00000100:00100000:2.0:1789176579.148828:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:852aa205-2094-4994-8a68-4550c04d9105+12:18717:x1876086955862656:12345-192.168.203.30@tcp:37:lfs.0 Request processed in 3887us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.148866:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1789176579.156223:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.156301:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955862912 00000100:00100000:1.0:1789176579.156320:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955862912 00000100:00100000:1.0:1789176579.156388:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1789176579.156399:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb581050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:852aa205-2094-4994-8a68-4550c04d9105+12:18717:x1876086955862912:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176579.156614:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb581050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:852aa205-2094-4994-8a68-4550c04d9105+13:18717:x1876086955862912:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 216us (400us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789176579.156621:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1789176579.208930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.209131:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955863040 00000100:00100000:3.0:1789176579.209141:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955863040 00000100:00100000:3.0:1789176579.209201:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:3.0:1789176579.209211:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+11:18723:x1876086955863040:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176579.209229:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.209248:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055682b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0223 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209306:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209320:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209452:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209467:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209490:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209497:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209568:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54bc00/0x4b53e3d2c0556840 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209577:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54bc00/0x4b53e3d2c0556840 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209584:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54bc00/0x4b53e3d2c0556840 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176579.209616:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176579.209620:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176579.209655:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54bc00/0x4b53e3d2c0556840 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209667:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209675:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209681:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209687:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176579.209691:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209705:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209717:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:3.0:1789176579.209719:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176579.209724:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209730:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209744:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209762:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209769:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209773:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176579.209776:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209782:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209790:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0bfd4f8c00) 00010000:00010000:3.0:1789176579.209792:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176579.209795:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.209812:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a000/0x4b53e3d2c0556839 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.210011:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055682b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0223 expref: 13 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.210026:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54bc00/0x4b53e3d2c0556840 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0223 expref: 12 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.210034:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:3.0:1789176579.210037:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789176579.210039:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54bc00, rc 0) 00000100:00100000:3.0:1789176579.210104:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+12:18723:x1876086955863040:12345-192.168.203.30@tcp:101:bash.0 Request processed in 894us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.210113:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1789176579.213766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.213986:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955863168 00000100:00100000:3.0:1789176579.213997:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955863168 00000100:00100000:3.0:1789176579.214064:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1789176579.214075:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18723:x1876086955863168:12345-192.168.203.30@tcp:900:bash.0 00000100:00100000:3.0:1789176579.214165:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:18723:x1876086955863168:12345-192.168.203.30@tcp:900:bash.0 Request processed in 92us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.214173:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00080000:0.0:1789176579.214665:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176579.217296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.217441:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955863424 00000100:00100000:1.0:1789176579.217452:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955863424 00000100:00100000:1.0:1789176579.217513:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1789176579.217522:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+12:18723:x1876086955863424:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1789176579.217556:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176579.217577:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556847 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe022a expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.217677:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.217691:0:22715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.217698:0:22715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.217728:0:22715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.217741:0:22715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 12 pid: 22714 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.217766:0:22715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1876086975898624:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176579.217889:0:22715:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176579.220393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.220472:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955863552 00000100:00100000:3.0:1789176579.220480:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955863552 00010000:00010000:3.0:1789176579.220514:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 13 pid: 22714 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176579.220569:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1789176579.220578:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:852aa205-2094-4994-8a68-4550c04d9105+13:2389:x1876086955863552:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176579.220591:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176579.220597:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 13 pid: 22714 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.220608:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 13 pid: 22714 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.220628:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:3.0:1789176579.220633:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.220643:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.220650:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.220668:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176579.220719:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:852aa205-2094-4994-8a68-4550c04d9105+13:2389:x1876086955863552:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 143us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.220726:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00010000:00010000:1.0:1789176579.221371:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c0556824 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe021c expref: 12 pid: 22714 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.221388:0:22715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1876086975898624:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176579.221409:0:22715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.221431:0:22715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.221438:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.221459:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.221469:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.221477:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222475:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222490:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222498:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176579.222509:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789176579.222535:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222541:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222548:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222561:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176579.222565:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222573:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222584:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:1.0:1789176579.222587:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176579.222591:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222596:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055684e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176579.222608:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000591b1cdb reply state 000000008b8deced transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222616:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222622:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0bfd4f8b00) 00010000:00010000:1.0:1789176579.222624:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176579.222627:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789176579.222658:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556847 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222671:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 14 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.222688:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:1.0:1789176579.222691:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789176579.222693:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3800, rc 0) 00000100:00100000:1.0:1789176579.222761:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+15:18723:x1876086955863424:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5231us (5465us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789176579.222770:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:2.0:1789176579.236076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.236210:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955863680 00000100:00100000:1.0:1789176579.236219:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955863680 00000100:00100000:1.0:1789176579.236273:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:1.0:1789176579.236282:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+15:18723:x1876086955863680:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1789176579.236305:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176579.236414:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c055686a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0231 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236478:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236490:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236501:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176579.236546:0:23785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789176579.236549:0:23785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176579.236565:0:23785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236591:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236615:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c055686a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 17 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236631:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 16 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.236640:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:1.0:1789176579.236644:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176579.236647:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2e00, rc 0) 00000100:00100000:1.0:1789176579.236698:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+16:18723:x1876086955863680:12345-192.168.203.30@tcp:101:bash.0 Request processed in 417us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176579.236705:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1789176579.240603:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.240696:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955863936 00000100:00100000:1.0:1789176579.240706:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955863936 00000100:00100000:1.0:1789176579.240771:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1789176579.240782:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+16:18723:x1876086955863936:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:1.0:1789176579.241095:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+17:18723:x1876086955863936:12345-192.168.203.30@tcp:35:bash.0 Request processed in 314us (498us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789176579.241103:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176579.304272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176579.304356:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955864064 00000100:00100000:0.0:1789176579.304365:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955864064 00000100:00100000:0.0:1789176579.304424:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:0.0:1789176579.304435:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+11:18085:x1876086955864064:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176579.304449:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176579.304468:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0556878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0238 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.304495:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0556878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0238 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.304506:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0556878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0238 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176579.304515:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c0000, rc 0) 00000100:00100000:0.0:1789176579.304575:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:953e177d-912f-4454-8195-4d36da584e3e+12:18085:x1876086955864064:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.304583:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1789176579.313098:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176579.313238:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955864192 00000100:00100000:2.0:1789176579.313259:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955864192 00000100:00100000:2.0:1789176579.313375:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:2.0:1789176579.313503:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+12:18085:x1876086955864192:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176579.313651:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+12:18085:x1876086955864192:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 267us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.313660:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000040:00080000:1.0:1789176579.314424:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176579.317802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.317952:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955864576 00000100:00100000:2.0:1789176579.317953:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.317961:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955864576 00000100:00100000:1.0:1789176579.318016:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1789176579.318025:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+12:18085:x1876086955864576:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176579.318552:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955864448 00000100:00100000:3.0:1789176579.318558:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955864448 00000100:00100000:3.0:1789176579.318606:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:3.0:1789176579.318622:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+17:18733:x1876086955864448:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176579.318640:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.318659:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055687f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe023f expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.318728:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+12:18085:x1876086955864576:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 703us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176579.318736:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000004:00200000:3.0:1789176579.323424:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789176579.323547:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055687f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe023f expref: 19 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.323564:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac189c000) 00010000:00010000:3.0:1789176579.323567:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176579.323573:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c055687f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe023f expref: 19 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.323586:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54ba00, rc 0) 00000100:00100000:3.0:1789176579.323654:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+18:18733:x1876086955864448:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 5033us (5700us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1789176579.323663:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1789176579.323807:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.324090:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955864704 00000100:00100000:3.0:1789176579.324098:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955864704 00000100:00100000:3.0:1789176579.324139:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:3.0:1789176579.324148:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+12:18085:x1876086955864704:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176579.324637:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.324655:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd54a000/0x4b53e3d2c055688d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0246 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.324679:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd54a000/0x4b53e3d2c055688d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0246 expref: 13 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.324704:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd54a000/0x4b53e3d2c055688d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0246 expref: 13 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.324713:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a000, rc 0) 00000100:00100000:3.0:1789176579.324768:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+13:18085:x1876086955864704:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 621us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.324776:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:0.0:1789176579.326342:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.326894:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955864960 00000100:00100000:1.0:1789176579.326905:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955864960 00000100:00100000:1.0:1789176579.326958:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1789176579.326968:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+18:18733:x1876086955864960:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176579.327167:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+19:18733:x1876086955864960:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 199us (840us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789176579.327178:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1789176579.327747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.327820:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955865088 00000100:00100000:1.0:1789176579.327827:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955865088 00000100:00100000:1.0:1789176579.328210:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:1.0:1789176579.328220:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+13:18085:x1876086955865088:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176579.328354:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:953e177d-912f-4454-8195-4d36da584e3e+13:18085:x1876086955865088:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 136us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176579.328362:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:2.0:1789176579.336497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.336572:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955865216 00000100:00100000:3.0:1789176579.336582:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955865216 00000100:00100000:3.0:1789176579.336642:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:3.0:1789176579.336653:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+13:18085:x1876086955865216:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176579.336798:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+13:18085:x1876086955865216:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 147us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.336806:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:3.0:1789176579.368322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.368455:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955865472 00000100:00100000:1.0:1789176579.368464:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955865472 00000100:00100000:1.0:1789176579.368565:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1789176579.368577:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+19:18738:x1876086955865472:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176579.368604:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176579.368626:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556894 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe024d expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.368776:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055689b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.368792:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055689b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.368804:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055689b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176579.368817:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789176579.369568:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2c00/0x4b53e3d2c0556894 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe024d expref: 22 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.369592:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055689b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe024d expref: 21 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.369602:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:2.0:1789176579.369604:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176579.369608:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3200, rc 0) 00000100:00100000:2.0:1789176579.369675:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18738:x1876086955865472:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1101us (1363us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789176579.369683:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1789176579.378011:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.378304:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955865728 00000100:00100000:1.0:1789176579.378313:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955865728 00000100:00100000:1.0:1789176579.378378:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1789176579.378389:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18738:x1876086955865728:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1789176579.378451:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378466:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378477:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378513:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378520:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378526:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378544:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176579.378548:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378555:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378567:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:1.0:1789176579.378570:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789176579.378574:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.378580:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789176579.379040:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789176579.379467:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18738:x1876086955865728:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 1076us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176579.379476:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:0.0:1789176579.384550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176579.386207:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.386352:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955865984 00000100:00100000:3.0:1789176579.386362:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955865984 00000100:00100000:3.0:1789176579.386420:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1789176579.386430:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18738:x1876086955865984:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176579.386659:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:18738:x1876086955865984:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 229us (459us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789176579.386668:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176579.392299:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955865600 00000100:00100000:2.0:1789176579.392313:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955865600 00000100:00100000:2.0:1789176579.392477:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1789176579.392488:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:2389:x1876086955865600:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176579.392517:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176579.392541:0:23871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055689b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe024d expref: 22 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.392564:0:23871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:2.0:1789176579.392569:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176579.392700:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:2389:x1876086955865600:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 214us (8157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.392707:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176579.635540:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176579.635564:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975898752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176579.635649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176579.635741:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975898752 00000100:00100000:0.0:1789176579.635758:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975898752 00000100:00100000:0.0:1789176579.635858:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176579.635869:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975898752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176579.635901:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789176579.635959:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975898752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176579.635966:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789176579.636099:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176579.636307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975898752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176579.684731:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.684871:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955866240 00000100:00100000:3.0:1789176579.684881:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955866240 00000100:00100000:3.0:1789176579.684947:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1789176579.684957:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18769:x1876086955866240:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1789176579.684991:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.685015:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568b0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0254 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.685132:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568b7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.685147:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.685159:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176579.685170:0:23785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789176579.685303:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568b0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0254 expref: 24 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.685452:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0254 expref: 23 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.685463:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176579.685466:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176579.685470:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54ba00, rc 0) 00000100:00100000:3.0:1789176579.685546:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+23:18769:x1876086955866240:12345-192.168.203.30@tcp:101:cat.0 Request processed in 590us (825us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789176579.685555:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1789176579.691418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176579.691459:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.691532:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955866624 00000100:00100000:1.0:1789176579.691542:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955866624 00000100:00100000:1.0:1789176579.691608:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1789176579.691619:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+23:2391:x1876086955866624:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176579.691635:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176579.691659:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568b7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0254 expref: 23 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.691677:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:1.0:1789176579.691681:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176579.691757:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:2391:x1876086955866624:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176579.691764:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1789176579.692895:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955866496 00000100:00100000:3.0:1789176579.692906:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955866496 00000100:00100000:3.0:1789176579.692950:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1789176579.692958:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:18769:x1876086955866496:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1789176579.693234:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+23:18769:x1876086955866496:12345-192.168.203.30@tcp:35:cat.0 Request processed in 275us (1823us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1789176579.693240:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1789176579.761391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.761537:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955866880 00000100:00100000:1.0:1789176579.761549:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955866880 00000100:00100000:1.0:1789176579.761619:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1789176579.761630:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+23:18775:x1876086955866880:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1789176579.761656:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176579.761678:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568c5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe025b expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.761823:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.761880:0:22715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.761890:0:22715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 24 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.761899:0:22715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.761932:0:22715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 24 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.761947:0:22715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 24 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.762041:0:22715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1876086975898880:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176579.762342:0:22715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.762352:0:22715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 24 pid: 22715 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.762363:0:22715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1876086975899008:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176579.762389:0:22715:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6776a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789176579.762703:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176579.768254:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176579.768306:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176579.768761:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955867008 00000100:00100000:2.0:1789176579.768771:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955867008 00010000:00010000:2.0:1789176579.768810:0:23871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 25 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.768877:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955867136 00000100:00100000:2.0:1789176579.768881:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955867136 00010000:00010000:2.0:1789176579.768894:0:23871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 26 pid: 22715 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176579.768916:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1789176579.768924:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+26:2389:x1876086955867008:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176579.768938:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176579.768945:0:23871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 26 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.768992:0:23871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 26 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769015:0:23871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:2.0:1789176579.769021:0:23871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769030:0:23871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769037:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176579.769083:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+26:2389:x1876086955867008:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 159us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.769105:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1789176579.769124:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1789176579.769131:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7485850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+25:2391:x1876086955867136:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176579.769139:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176579.769144:0:23871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 25 pid: 22715 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769155:0:23871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 25 pid: 22715 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769166:0:23871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:2.0:1789176579.769462:0:23871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769483:0:23871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769492:0:23871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.769511:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176579.769532:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7485850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+25:2391:x1876086955867136:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 401us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.769540:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:1.0:1789176579.770796:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556871 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0231 expref: 24 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.770819:0:22715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1876086975898880:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176579.770930:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055685c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe022a expref: 23 pid: 22715 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176579.770943:0:22715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1876086975899008:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176579.770964:0:22715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.770986:0:22715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.770993:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176579.771029:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789176579.771379:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05568c5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe025b expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.771396:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05568cc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe025b expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176579.771405:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:1.0:1789176579.771408:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789176579.771412:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3200, rc 0) 00000100:00100000:1.0:1789176579.771472:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+23:18775:x1876086955866880:12345-192.168.203.30@tcp:101:dd.0 Request processed in 9844us (10091us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1789176579.771481:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:0.0:1789176579.774036:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.774445:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955867264 00000100:00100000:3.0:1789176579.774455:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955867264 00000100:00100000:3.0:1789176579.774520:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1789176579.774531:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+23:18775:x1876086955867264:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176579.774555:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.774576:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568da lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0262 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.774610:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.774622:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.774632:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.774746:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568da lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 25 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.774783:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 24 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.774793:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176579.774796:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176579.774799:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a600, rc 0) 00000100:00100000:3.0:1789176579.774892:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+24:18775:x1876086955867264:12345-192.168.203.30@tcp:101:dd.0 Request processed in 363us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.774900:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1789176579.778720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.778823:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955867520 00000100:00100000:3.0:1789176579.778950:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955867520 00000100:00100000:3.0:1789176579.779040:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1789176579.779051:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+24:18775:x1876086955867520:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1789176579.779286:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.779304:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.779326:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176579.779371:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1789176579.779394:0:22714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e11993fb reply state 0000000039163425 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.779407:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.779430:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176579.779433:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176579.779437:0:22714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176579.779533:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+27:18775:x1876086955867520:12345-192.168.203.30@tcp:36:dd.0 Request processed in 482us (819us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1789176579.779540:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000020:00080000:3.0:1789176579.779546:0:22714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789176579.782343:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.782473:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955867648 00000100:00100000:3.0:1789176579.782482:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955867648 00000100:00100000:3.0:1789176579.782538:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1789176579.782549:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+27:18775:x1876086955867648:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176579.782571:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.782592:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0269 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.782645:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568ef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0269 expref: 28 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.782661:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568ef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0269 expref: 28 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.782680:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176579.782683:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176579.782687:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a200, rc 0) 00000100:00100000:3.0:1789176579.782755:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18775:x1876086955867648:12345-192.168.203.30@tcp:101:dd.0 Request processed in 198us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.782762:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1789176579.795557:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176579.795676:0:23871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955867904 00000100:00100000:2.0:1789176579.795685:0:23871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955867904 00000100:00100000:2.0:1789176579.795800:0:23871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1789176579.795811:0:23871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18775:x1876086955867904:12345-192.168.203.30@tcp:103:dd.0 00010000:00010000:2.0:1789176579.795827:0:23871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176579.795893:0:23871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c05568ef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0269 expref: 28 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176579.795912:0:23871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:2.0:1789176579.795918:0:23871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176579.795978:0:23871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+27:18775:x1876086955867904:12345-192.168.203.30@tcp:103:dd.0 Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176579.795985:0:23871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1789176579.798158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176579.798266:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955868032 00000100:00100000:1.0:1789176579.798275:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955868032 00000100:00100000:3.0:1789176579.798408:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1789176579.798421:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+27:18775:x1876086955868032:12345-192.168.203.30@tcp:58:dd.0 00010000:00010000:3.0:1789176579.798524:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.798542:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.798556:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176579.799539:0:22714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176579.799570:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1789176579.799722:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1789176579.799968:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+27:18775:x1876086955868032:12345-192.168.203.30@tcp:58:dd.0 Request processed in 1545us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.799979:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1789176579.802525:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176579.802630:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955868160 00000100:00100000:3.0:1789176579.802639:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955868160 00000100:00100000:3.0:1789176579.802756:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1789176579.802767:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+27:18775:x1876086955868160:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176579.802787:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176579.802808:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0270 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.802898:0:23785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.802911:0:23785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 28 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.802944:0:23785:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.802959:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 28 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.802973:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176579.802975:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176579.802979:0:23785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 28 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176579.802987:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54b800, rc 0) 00000100:00100000:3.0:1789176579.803085:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18775:x1876086955868160:12345-192.168.203.30@tcp:101:dd.0 Request processed in 318us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176579.803102:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000040:00080000:1.0:1789176580.338059:0:22750:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789176580.338067:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176580.338111:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789176580.338132:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789176580.338545:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22750:1876086975899136:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176580.338634:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176580.345383:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22750:1876086975899136:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789176580.347661:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176580.348495:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955868288 00000100:00100000:1.0:1789176580.348508:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955868288 00000100:00100000:1.0:1789176580.348606:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1789176580.348616:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18776:x1876086955868288:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789176580.348653:0:22715:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789176580.348779:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18776:x1876086955868288:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 163us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.348786:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1789176580.356931:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.357160:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955868416 00000100:00100000:2.0:1789176580.357170:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955868416 00000100:00100000:2.0:1789176580.357244:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1789176580.357255:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18776:x1876086955868416:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789176580.357545:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357563:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357575:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357592:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357600:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357606:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357631:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357640:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357646:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176580.357699:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789176580.357717:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176580.357734:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357755:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357762:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357768:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357774:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176580.357778:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357786:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357805:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10bcc00) 00010000:00010000:2.0:1789176580.357807:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176580.357812:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357817:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556904 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357980:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.357990:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358007:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358012:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176580.358015:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358022:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358031:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9f0ac7472000) 00010000:00010000:2.0:1789176580.358034:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176580.358037:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358042:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055690b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358058:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358065:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358070:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358074:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176580.358077:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358091:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358099:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:2.0:1789176580.358101:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176580.358104:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.358109:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556912 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.358358:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18776:x1876086955868416:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1096us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176580.358367:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1789176580.364761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.365202:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955868672 00000100:00100000:3.0:1789176580.365212:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955868672 00000100:00100000:3.0:1789176580.366514:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1789176580.366530:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+28:18776:x1876086955868672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.366551:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176580.366573:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556919 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0277 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.366679:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.366693:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.366716:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176580.366729:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789176580.366819:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.366827:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.367864:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.367871:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ac00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176580.367875:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.368005:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.368020:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176580.368023:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789176580.368028:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.368034:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556920 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.368088:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556919 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0277 expref: 30 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.368117:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10bcc00) 00010000:00010000:3.0:1789176580.368119:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176580.368124:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556919 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0277 expref: 30 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.368133:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54b200, rc 0) 00000100:00100000:3.0:1789176580.368212:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+29:18776:x1876086955868672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1687us (3470us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1789176580.368220:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1789176580.373306:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.373540:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955868800 00000100:00100000:3.0:1789176580.373550:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955868800 00000100:00100000:3.0:1789176580.373610:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1789176580.373621:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+29:18776:x1876086955868800:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789176580.373657:0:23785:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789176580.373777:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+29:18776:x1876086955868800:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 157us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.373786:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1789176580.381568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176580.381692:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955869056 00000100:00100000:1.0:1789176580.381701:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955869056 00000100:00100000:1.0:1789176580.381814:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1789176580.381824:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+29:18776:x1876086955869056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176580.382031:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176580.382055:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055692e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe027e expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789176580.383076:0:22715:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1789176580.383085:0:22715:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1789176580.383109:0:22715:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1789176580.383338:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556935 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.383354:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556935 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.383365:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556935 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.383424:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c055692e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe027e expref: 32 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.383444:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556935 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe027e expref: 31 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.383466:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176580.383469:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176580.383473:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2e00, rc 0) 00000100:00100000:1.0:1789176580.383740:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+31:18776:x1876086955869056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1915us (2179us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1789176580.383757:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1789176580.390314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.390586:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955869312 00000100:00100000:2.0:1789176580.390597:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955869312 00000100:00100000:2.0:1789176580.390656:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:2.0:1789176580.390666:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+31:18776:x1876086955869312:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789176580.390721:0:22716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176580.390758:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0556935 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe027e expref: 31 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.390779:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176580.390790:0:22716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176580.390813:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.390827:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.390873:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391308:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391429:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391438:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391481:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391489:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391495:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391501:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176580.391506:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391513:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391522:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:2.0:1789176580.391525:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176580.391529:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391543:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0556943 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391554:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391560:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391566:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391572:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176580.391575:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391582:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391591:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x666accec (ffff9f0ac7472000) 00010000:00010000:2.0:1789176580.391593:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176580.391596:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.391602:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c055694a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x666accec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.391681:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+30:18776:x1876086955869312:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1015us (1374us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176580.391688:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1789176580.399067:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.410498:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955869440 00000100:00100000:3.0:1789176580.410515:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955869440 00000100:00100000:3.0:1789176580.410592:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1789176580.410602:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+30:18776:x1876086955869440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.410621:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176580.410646:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556951 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0285 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.410709:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556958 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.410724:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556958 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.410736:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556958 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.410868:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556951 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0285 expref: 32 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.410887:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ac00/0x4b53e3d2c0556958 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0285 expref: 31 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.410897:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.410900:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176580.410904:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54ac00, rc 0) 00000100:00100000:3.0:1789176580.410962:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+31:18776:x1876086955869440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 361us (11904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.410969:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1789176580.418357:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.422015:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955869696 00000100:00100000:3.0:1789176580.422030:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955869696 00000100:00100000:3.0:1789176580.422117:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1789176580.422127:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+31:18776:x1876086955869696:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.422219:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.422255:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.422268:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176580.422453:0:23785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1789176580.422463:0:23785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683631354ns, next at 702683629133ns, rc = 0 00000004:00010000:3.0:1789176580.422511:0:23785:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9d5df9f reply state 00000000bf23b7a8 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.422523:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.422530:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.422533:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789176580.422536:0:23785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176580.422631:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+33:18776:x1876086955869696:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 506us (4290us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1789176580.422639:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1789176580.425140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.425217:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955869824 00000100:00100000:3.0:1789176580.425227:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955869824 00000100:00100000:3.0:1789176580.425287:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1789176580.425298:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+33:18776:x1876086955869824:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.425329:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176580.425349:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe028c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.425426:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 34 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.425441:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 34 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.425459:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.425462:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176580.425466:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a800, rc 0) 00000100:00100000:3.0:1789176580.425522:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+34:18776:x1876086955869824:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 225us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.425529:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1789176580.427503:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.427603:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955869952 00000100:00100000:2.0:1789176580.427613:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955869952 00000100:00100000:2.0:1789176580.427682:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176580.427693:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2390:x1876086955869952:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789176580.427986:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2390:x1876086955869952:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 294us (490us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789176580.427993:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:3.0:1789176580.429080:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176580.434380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.434514:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955870208 00000100:00100000:3.0:1789176580.434525:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955870208 00000100:00100000:3.0:1789176580.434585:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1789176580.434595:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+34:18776:x1876086955870208:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789176580.434877:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+35:18776:x1876086955870208:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 282us (504us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1789176580.434885:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1789176580.438363:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.438497:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955870464 00000100:00100000:3.0:1789176580.438506:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955870464 00000100:00100000:3.0:1789176580.438561:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1789176580.438571:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+35:18776:x1876086955870464:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789176580.438671:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+35:18776:x1876086955870464:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.438691:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1789176580.444145:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.444257:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955870592 00000100:00100000:3.0:1789176580.444267:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955870592 00000100:00100000:3.0:1789176580.444374:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1789176580.444386:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+35:18776:x1876086955870592:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.444405:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176580.444428:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c055696d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0293 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.444524:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556974 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.444538:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556974 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.444551:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556974 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176580.444593:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176580.444614:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556974 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.444640:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c055696d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0293 expref: 37 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.444658:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556974 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0293 expref: 36 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.444667:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.444676:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789176580.444679:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a200, rc 0) 00000100:00100000:3.0:1789176580.444761:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+36:18776:x1876086955870592:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 377us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.444768:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1789176580.448259:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.448337:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955870720 00000100:00100000:2.0:1789176580.448347:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955870720 00000100:00100000:2.0:1789176580.448398:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1789176580.448408:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2390:x1876086955870720:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176580.448424:0:24225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176580.448445:0:24225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe029a expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176580.448469:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ab03, blocks: 0x0 00010000:00010000:2.0:1789176580.448487:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=701s v=(0 0) 00010000:00010000:2.0:1789176580.448491:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176580.448500:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 7 pid: 24225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.448519:0:24225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 7 pid: 24225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.448532:0:24225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495e00, rc 0) 00000100:00100000:2.0:1789176580.448604:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:2390:x1876086955870720:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176580.448611:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1789176580.453635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.453728:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955870976 00000100:00100000:3.0:1789176580.453739:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955870976 00000100:00100000:3.0:1789176580.453800:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1789176580.453810:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+36:18776:x1876086955870976:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789176580.453941:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+36:18776:x1876086955870976:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.453950:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1789176580.462200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176580.462307:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955871104 00000100:00100000:0.0:1789176580.462328:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955871104 00000100:00100000:0.0:1789176580.462388:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1789176580.462399:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+36:18776:x1876086955871104:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789176580.468539:0:22694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1789176580.468557:0:22694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789176580.468608:0:22694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1789176580.468764:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+19:18776:x1876086955871104:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 6362us (6569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176580.468780:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00010000:00010000:2.0:1789176580.468974:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.468986:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.468994:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.468999:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176580.469003:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.469010:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.469027:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:2.0:1789176580.469030:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789176580.469034:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.469041:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c05567e5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176580.469637:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176580.469658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975899264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789176580.469709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.470135:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975899264 00000100:00100000:3.0:1789176580.470143:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975899264 00000100:00100000:3.0:1789176580.470203:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176580.470212:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975899264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789176580.470349:0:24224:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789176580.470353:0:24224:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789176580.470356:0:24224:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789176580.470358:0:24224:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789176579 -> 1789176579 00002000:00010000:3.0:1789176580.470359:0:24224:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789176580.470404:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975899264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (694us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789176580.470413:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1789176580.470452:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac7d69500/2, rc 0, transno 12884901892 00000100:00100000:3.0:1789176580.470458:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975899264:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789176580.471617:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176580.472905:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.473244:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955871232 00000100:00100000:2.0:1789176580.473254:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955871232 00000100:00100000:2.0:1789176580.473320:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1789176580.473332:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:2390:x1876086955871232:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789176580.473448:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:2390:x1876086955871232:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 119us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176580.473456:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00010000:00010000:0.0:1789176580.475807:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.475822:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476017:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476036:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176580.476042:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476050:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476067:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0bfd4f8c00) 00010000:00010000:0.0:1789176580.476070:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176580.476075:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476083:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055676e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476105:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476112:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476118:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476123:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176580.476126:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476131:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476150:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0bfd4f8900) 00010000:00010000:0.0:1789176580.476152:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176580.476156:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476162:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0556775 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476177:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476183:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476189:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476193:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176580.476196:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476201:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476208:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0bfd4f8b00) 00010000:00010000:0.0:1789176580.476210:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176580.476212:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476217:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0556855 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476245:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476251:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476256:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476262:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54ba00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176580.476265:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476271:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476279:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:0.0:1789176580.476282:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176580.476284:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476289:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05568e8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476299:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476304:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476309:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476471:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176580.476474:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476480:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476489:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:0.0:1789176580.476491:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789176580.476494:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.476499:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c055695f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.477234:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.477343:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955871488 00000100:00100000:3.0:1789176580.477352:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955871488 00000100:00100000:3.0:1789176580.477406:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1789176580.477417:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+15:18776:x1876086955871488:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.477465:0:23785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176580.477484:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556974 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0293 expref: 15 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.477497:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.477501:0:23785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176580.477528:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556982 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.477541:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556982 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.477551:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556982 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176580.477669:0:23785:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051d2a110 reply state 00000000c5f553a4 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556982 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.477681:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b200/0x4b53e3d2c0556982 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.477687:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.477689:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176580.477692:0:23785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176580.477795:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+16:18776:x1876086955871488:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 379us (565us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789176580.477815:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1789176580.480892:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176580.480967:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955871616 00000100:00100000:0.0:1789176580.480976:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955871616 00000100:00100000:0.0:1789176580.481028:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1789176580.481037:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:18776:x1876086955871616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176580.481054:0:24884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176580.481070:0:24884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe02a1 expref: -99 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.481098:0:24884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 8 pid: 24225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.481106:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176580.481110:0:24884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176580.481128:0:24884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 8 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.481161:0:24884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 8 pid: 24225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.481174:0:24884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 8 pid: 24225 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176580.481187:0:24884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc438ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24884:1876086975899392:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176580.481258:0:24884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176580.484409:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176580.484493:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955871744 00000100:00100000:1.0:1789176580.484502:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955871744 00010000:00010000:1.0:1789176580.484540:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 9 pid: 24225 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176580.484581:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1789176580.484591:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:2390:x1876086955871744:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176580.484606:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176580.484626:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 9 pid: 24225 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.484640:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 9 pid: 24225 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.484662:0:22700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176580.484667:0:22700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176580.484673:0:22700:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.484697:0:22700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.484732:0:22700:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176580.484757:0:22700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22700:1876086975899520:192.168.203.30@tcp:105: 00000100:00100000:1.0:1789176580.484871:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109b780 going to sleep for 11 seconds 00010000:00010000:2.0:1789176580.485475:0:24884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c055697b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe029a expref: 9 pid: 24225 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.485491:0:24884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc438ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24884:1876086975899392:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176580.485514:0:24884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 8 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.485525:0:24884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c0c00, rc 0) 00000100:00100000:2.0:1789176580.485575:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+8:18776:x1876086955871616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4538us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176580.485583:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1789176580.489690:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.489766:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955871872 00000100:00100000:2.0:1789176580.489775:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955871872 00000100:00100000:2.0:1789176580.489863:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1789176580.489873:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+8:2390:x1876086955871872:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789176580.490007:0:25231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789176580.490011:0:25231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789176579 00002000:00010000:2.0:1789176580.490014:0:25231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789176578 00002000:00010000:2.0:1789176580.490016:0:25231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789176579 -> 1789176579 00002000:00010000:2.0:1789176580.490019:0:25231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789176580.490072:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:2390:x1876086955871872:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 200us (390us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789176580.490080:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1789176580.490675:0:22700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22700:1876086975899520:192.168.203.30@tcp:105: 00010000:00010000:1.0:1789176580.490697:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176580.490733:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+8:2390:x1876086955871744:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 6143us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.490751:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1789176580.494342:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.494432:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955872000 00000100:00100000:2.0:1789176580.494441:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955872000 00000100:00100000:2.0:1789176580.494496:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1789176580.494507:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc438d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+8:2392:x1876086955872000:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789176580.494551:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.494572:0:24225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 8 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.494581:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176580.494585:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176580.494590:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.494626:0:24225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 8 pid: 24884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.494641:0:24225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 8 pid: 24884 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.494655:0:24225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24225:1876086975899648:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176580.494737:0:24225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493540 going to sleep for 11 seconds 00000100:00100000:2.0:1789176580.499262:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176580.499515:0:24225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24225:1876086975899648:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176580.499543:0:24225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.499680:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955872128 00000100:00100000:3.0:1789176580.499687:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955872128 00010000:00010000:3.0:1789176580.499717:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.499760:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1789176580.499769:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+9:2389:x1876086955872128:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176580.499782:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176580.499802:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.499815:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.499878:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbeea8ed/0x4b53e3d2c0556989 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a1 expref: 9 pid: 24884 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.499894:0:22701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176580.499898:0:22701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176580.499904:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.499914:0:22701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.499948:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176580.500089:0:24225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500099:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500117:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500131:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500140:0:24225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500147:0:24225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176580.500151:0:24225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500160:0:24225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500171:0:24225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.500180:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5ba00c/0x4b53e3d2c0556990 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.500257:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+8:2389:x1876086955872128:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 488us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.500265:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176580.501655:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc438d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+7:2392:x1876086955872000:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 7143us (7328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176580.501667:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1789176580.508465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.508573:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955872384 00000100:00100000:3.0:1789176580.508584:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955872384 00000100:00100000:3.0:1789176580.508652:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1789176580.508663:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+16:18776:x1876086955872384:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789176580.508757:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.508775:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 16 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.508786:0:22714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.508820:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 16 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.508978:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 16 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.508993:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22714:1876086975899776:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176580.509752:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac71153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176580.518774:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22714:1876086975899776:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176580.518815:0:22714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.518828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176580.519525:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955872512 00000100:00100000:0.0:1789176580.519534:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955872512 00010000:00010000:0.0:1789176580.519574:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 17 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176580.519632:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176580.519642:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+17:2389:x1876086955872512:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176580.519670:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176580.519678:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 17 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519692:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 17 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519716:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05568e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0262 expref: 17 pid: 23785 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519733:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:0.0:1789176580.519739:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 16 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519762:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519770:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519776:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176580.519806:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176580.519857:0:22714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.519867:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176580.519905:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+16:2389:x1876086955872512:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 263us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176580.519920:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00010000:00010000:1.0:1789176580.520065:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.520083:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 16 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.520091:0:22714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.520119:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 16 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.520131:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 16 pid: 22714 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176580.520144:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22714:1876086975899904:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176580.520196:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176580.522770:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22714:1876086975899904:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176580.522808:0:22714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.524255:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176580.524513:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955872640 00000100:00100000:0.0:1789176580.524523:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955872640 00010000:00010000:1.0:1789176580.524699:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 17 pid: 22714 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176580.524789:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176580.524800:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+17:2389:x1876086955872640:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176580.524815:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176580.524822:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 17 pid: 22714 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.524883:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 17 pid: 22714 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.524906:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a800/0x4b53e3d2c0556966 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe028c expref: 17 pid: 22714 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.524924:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:1.0:1789176580.524929:0:22701:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.524938:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.524945:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.524978:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176580.525031:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b36a1ad-41a8-406e-85d7-4063c4e2797a+16:2389:x1876086955872640:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 233us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.525038:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:3.0:1789176580.525096:0:22714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.525115:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176580.525224:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1789176580.525349:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1789176580.525387:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1789176580.525463:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22714:1876086975900032:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176580.525511:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.525545:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900032 00000100:00100000:3.0:1789176580.525549:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900032 00000100:00100000:3.0:1789176580.525579:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789176580.525599:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22714:x1876086975900032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176580.525664:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22714:x1876086975900032:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.525671:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789176580.525693:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176580.525717:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22714:1876086975900032:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789176580.525916:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1789176580.525950:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22714:1876086975900160:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176580.525974:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.525994:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900160 00000100:00100000:3.0:1789176580.525997:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900160 00000100:00100000:3.0:1789176580.526015:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789176580.526021:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22714:x1876086975900160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176580.526114:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22714:x1876086975900160:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (138us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1789176580.526130:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789176580.526146:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176580.526161:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22714:1876086975900160:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789176580.526185:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526192:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526198:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526203:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176580.526208:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526215:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526226:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.526229:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176580.526233:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526239:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2200/0x4b53e3d2c055699e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526264:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526271:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526281:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526286:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176580.526289:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526295:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526302:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176580.526305:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176580.526309:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 19 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526320:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 19 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526328:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 19 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.526381:0:22714:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b800/0x4b53e3d2c05568fd lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0270 expref: 19 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.526394:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22714:1876086975900288:192.168.203.30@tcp:105: 00000100:00100000:3.0:1789176580.526436:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcc910f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176580.529676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.529874:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22714:1876086975900288:192.168.203.30@tcp:105: 00010000:00010000:3.0:1789176580.529917:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.529928:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b000/0x4b53e3d2c05568f6 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.529960:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.529974:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.529986:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.529999:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530005:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530013:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530018:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54b400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176580.530022:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530030:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530042:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176580.530052:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176580.530057:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530063:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54b400/0x4b53e3d2c05569a5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530074:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530080:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530087:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530092:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd54a200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176580.530095:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530101:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530109:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176580.530112:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176580.530115:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.530121:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a200/0x4b53e3d2c0556997 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.530350:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b36a1ad-41a8-406e-85d7-4063c4e2797a+19:18776:x1876086955872384:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 21689us (21893us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789176580.530370:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000020:00080000:3.0:1789176580.530376:0:22714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789176580.531887:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:2.0:1789176580.532307:0:22750:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789176580.532313:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789176580.532343:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789176580.532349:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789176580.532558:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955872768 00000100:00100000:0.0:1789176580.532566:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955872768 00000100:00100000:1.0:1789176580.532679:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873024 00000100:00100000:1.0:1789176580.532683:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873024 00000100:00100000:1.0:1789176580.532707:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1789176580.532716:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0beb581450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+20:18775:x1876086955872768:12345-192.168.203.30@tcp:49:dd.0 00000100:00100000:1.0:1789176580.532868:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0beb581450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+20:18775:x1876086955872768:12345-192.168.203.30@tcp:49:dd.0 Request processed in 151us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.532875:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1789176580.532921:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1789176580.532927:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+19:18776:x1876086955873024:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789176580.533124:0:22718:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789176580.533153:0:22718:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1789176580.533184:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.533201:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.533212:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.533220:0:22718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.533226:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.533232:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.533252:0:22718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789176580.533297:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18776:x1876086955873024:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 369us (1415us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1789176580.533304:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000020:00080000:1.0:1789176580.533308:0:22718:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789176580.533506:0:25227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176580.533514:0:25227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.533521:0:25227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176580.533525:0:25227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.533534:0:25227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.533546:0:25227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0ac10bc200) 00010000:00010000:3.0:1789176580.533549:0:25227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789176580.533553:0:25227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.533559:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3800/0x4b53e3d2c05569ac lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.533570:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176580.533572:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176580.533574:0:25227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176580.536151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176580.536203:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873152 00000100:00100000:3.0:1789176580.536211:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873152 00000100:00100000:3.0:1789176580.536255:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1789176580.536263:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+21:18775:x1876086955873152:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176580.536280:0:23785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176580.536306:0:23785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05569b3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe02a8 expref: -99 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.536346:0:23785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05569ba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.536360:0:23785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05569ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.536372:0:23785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05569ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.536486:0:23785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54ba00/0x4b53e3d2c05569b3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a8 expref: 23 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.536504:0:23785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd54a600/0x4b53e3d2c05569ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe02a8 expref: 22 pid: 23785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176580.536514:0:23785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0bfd4f8a00) 00010000:00010000:3.0:1789176580.536517:0:23785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176580.536520:0:23785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd54a600, rc 0) 00000100:00100000:3.0:1789176580.536569:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:18775:x1876086955873152:12345-192.168.203.30@tcp:101:dd.0 Request processed in 305us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.536576:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:2.0:1789176580.556680:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176580.556726:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176580.556819:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873408 00000100:00100000:1.0:1789176580.556871:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873408 00000100:00100000:1.0:1789176580.556952:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873280 00000100:00100000:1.0:1789176580.556956:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873280 00000100:00100000:1.0:1789176580.556977:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1789176580.556987:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+8:2392:x1876086955873408:12345-192.168.203.30@tcp:4:dd.0 00002000:00010000:1.0:1789176580.557036:0:24229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa4ab03, atime: 0x6aa4ab02, ctime: 0x6aa4ab03, blocks: 0x0 00010000:00010000:1.0:1789176580.557045:0:24229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.557062:0:24229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=701s v=(0 0) 00010000:00010000:1.0:1789176580.557067:0:24229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176580.557072:0:24229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176580.557086:0:24229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789176580.628909:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1789176580.628932:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1789176580.630012:0:24229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1789176580.630021:0:24229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1789176580.630049:0:24229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630066:0:24229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630077:0:24229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630086:0:24229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176580.630092:0:24229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630102:0:24229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630172:0:24229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630182:0:24229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c96fff2/0x4b53e3d2c05569c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.630346:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+6:2392:x1876086955873408:12345-192.168.203.30@tcp:4:dd.0 Request processed in 73352us (73668us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789176580.630364:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1789176580.630418:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1789176580.630433:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2392:x1876086955873280:12345-192.168.203.30@tcp:4:dd.0 00002000:00010000:2.0:1789176580.630622:0:24229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6aa4ab03, atime: 0x6aa4ab02, ctime: 0x6aa4ab03, blocks: 0x1a68 00010000:00010000:2.0:1789176580.630629:0:24229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630643:0:24229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=701s v=(0 0) 00010000:00010000:2.0:1789176580.630648:0:24229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176580.630656:0:24229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.630671:0:24229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176580.658453:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975900800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176580.658454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc438d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975900416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176580.658592:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975900544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176580.660706:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.660762:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176580.660773:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975900672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176580.660802:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.660870:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900800 00000100:00100000:3.0:1789176580.660877:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900800 00000100:00100000:3.0:1789176580.660913:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900672 00000100:00100000:3.0:1789176580.660916:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900672 00000100:00100000:3.0:1789176580.660930:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789176580.660938:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975900800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176580.660971:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1789176580.661011:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975900800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.661017:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789176580.661033:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789176580.661038:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975900672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176580.661051:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789176580.661073:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975900672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 36us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.661078:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789176580.661114:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975900672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176580.661130:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975900800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176580.661375:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975901312:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661403:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975901824:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661468:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789176580.661474:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975901184:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661523:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975901696:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661541:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661555:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975902208:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661574:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661597:0:24884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901184 00000100:00100000:3.0:1789176580.661601:0:24884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901184 00000100:00100000:1.0:1789176580.661617:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661636:0:24884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789176580.661642:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975900928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176580.661643:0:24884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975901184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.661662:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661674:0:24884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975901184:12345-0@lo:400:kworker.0 Request processed in 32us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.661676:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975901440:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661680:0:24884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789176580.661694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789176580.661696:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176580.661706:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901440 00000100:00100000:1.0:1789176580.661708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975901952:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661709:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901440 00000100:00100000:1.0:1789176580.661727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661729:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789176580.661734:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975901440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.661738:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176580.661756:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975901056:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661776:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975901440:12345-0@lo:400:kworker.0 Request processed in 42us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.661782:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789176580.661787:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661810:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975901184:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.661811:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975901568:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.661844:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661845:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901312 00000100:00100000:3.0:1789176580.661848:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901312 00000100:00100000:1.0:1789176580.661861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975902080:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661866:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901824 00000100:00100000:3.0:1789176580.661868:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901824 00000100:00100000:1.0:1789176580.661882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176580.661884:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901696 00000100:00100000:3.0:1789176580.661886:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901696 00000100:00100000:3.0:1789176580.661895:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975902208 00000100:00100000:3.0:1789176580.661897:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975902208 00000100:00100000:1.0:1789176580.661900:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975901440:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.661917:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901952 00000100:00100000:1.0:1789176580.661919:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900416 00000100:00100000:3.0:1789176580.661920:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901952 00000100:00100000:1.0:1789176580.661922:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900416 00000100:00100000:3.0:1789176580.661930:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975902080 00000100:00100000:3.0:1789176580.661932:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975902080 00000100:00100000:1.0:1789176580.661939:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900928 00000100:00100000:3.0:1789176580.661942:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789176580.661942:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900928 00000100:00100000:3.0:1789176580.661947:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975901312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.661952:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176580.661957:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975900416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176580.661974:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176580.661979:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975901312:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.661985:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789176580.661997:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789176580.662002:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975901824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662005:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975900416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.662010:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176580.662021:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176580.662023:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975901824:12345-0@lo:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.662027:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975900928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176580.662029:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00002000:00000024:1.0:1789176580.662035:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176580.662038:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789176580.662043:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975901696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662055:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975900928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.662061:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176580.662062:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975901696:12345-0@lo:400:kworker.0 Request processed in 20us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.662067:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176580.662075:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901568 00000100:00100000:3.0:1789176580.662076:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176580.662077:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901568 00000100:00100000:3.0:1789176580.662081:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975902208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.662106:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975902208:12345-0@lo:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.662111:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789176580.662121:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789176580.662127:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975901952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.662163:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975901952:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.662170:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789176580.662181:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789176580.662187:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975902080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.662212:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975902080:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.662218:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789176580.662232:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176580.662235:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176580.662237:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176580.662248:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176580.662252:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975901696:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662255:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975901568:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789176580.662264:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8472680 x1876086975902208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176580.662274:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975902208:0@lo:400:kworker.0 00000100:00100000:3.0:1789176580.662284:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975901312:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662287:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975901568:12345-0@lo:400:kworker.0 Request processed in 33us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176580.662291:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975901824:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662293:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176580.662398:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975901568:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662408:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975902080:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662420:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975900928:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789176580.662428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8472a00 x1876086975901952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176580.662437:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975901952:0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662447:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc438d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975900416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176580.662473:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975901056 00000100:00100000:1.0:1789176580.662476:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975901056 00000100:00100000:1.0:1789176580.662508:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789176580.662516:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3644:x1876086975901056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176580.662552:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de6bc3dc-0fde-4253-a7e7-b570e971a5be+24:3644:x1876086975901056:12345-0@lo:400:kworker.0 Request processed in 37us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.662558:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789176580.662586:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de6bc3dc-0fde-4253-a7e7-b570e971a5be:3644:1876086975901056:0@lo:400:kworker.0 00000100:00100000:2.0:1789176580.663815:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176580.663897:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975900544 00000100:00100000:1.0:1789176580.663907:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975900544 00000100:00100000:1.0:1789176580.663964:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176580.663972:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975900544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176580.663992:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 30543552 pending 4218880 free 3915849728 avail 3680841728 00000100:00100000:1.0:1789176580.664275:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975900544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176580.664283:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176580.666805:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1789176580.666816:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac7d69500, transno 12884901892 00000004:00080000:2.0:1789176580.666982:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1789176580.667022:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975900544:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789176580.709626:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1789176580.709875:0:24229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1789176580.709903:0:24229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.709922:0:24229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.709930:0:24229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.709937:0:24229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176580.709943:0:24229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.709952:0:24229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.709970:0:24229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176580.709978:0:24229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009900f828/0x4b53e3d2c05569c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176580.710093:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2392:x1876086955873280:12345-192.168.203.30@tcp:4:dd.0 Request processed in 79661us (153361us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789176580.710103:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:2.0:1789176580.788111:0:25228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176581.812797:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789176582.062969:0:25801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1789176582.254248:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254299:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254334:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254359:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254392:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254474:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176582.254498:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176582.254514:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873792 00000100:00100000:3.0:1789176582.254528:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873792 00000100:00100000:1.0:1789176582.254530:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955874304 00000100:00100000:1.0:1789176582.254537:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955874304 00000100:00100000:3.0:1789176582.254600:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873664 00000100:00100000:3.0:1789176582.254604:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873664 00000100:00100000:3.0:1789176582.254624:0:23785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955874176 00000100:00100000:3.0:1789176582.254626:0:23785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955874176 00000100:00100000:3.0:1789176582.254650:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1789176582.254662:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955873792:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176582.254674:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873536 00000100:00100000:2.0:1789176582.254678:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873536 00000100:00100000:2.0:1789176582.254713:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:2.0:1789176582.254720:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc6b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+13:2389:x1876086955873536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176582.254782:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc6b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:953e177d-912f-4454-8195-4d36da584e3e+13:2389:x1876086955873536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 60us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176582.254790:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:3.0:1789176582.254906:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955873792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 243us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176582.254913:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1789176582.254941:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1789176582.254950:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:2389:x1876086955873664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176582.254983:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b36a1ad-41a8-406e-85d7-4063c4e2797a+22:2389:x1876086955873664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176582.254990:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1789176582.255111:0:23785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1789176582.255633:0:23785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955874176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176582.255683:0:23785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852aa205-2094-4994-8a68-4550c04d9105+6:2389:x1876086955874176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 565us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176582.255690:0:23785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00080000:3.0:1789176582.255716:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176582.255721:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176582.256399:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1789176582.256415:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955874304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176582.256475:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955874304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176582.256484:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1789176582.256515:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955874048 00000100:00100000:1.0:1789176582.256525:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955874048 00000100:00100000:1.0:1789176582.256580:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955874560 00000100:00100000:1.0:1789176582.256583:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955874560 00000100:00100000:1.0:1789176582.256599:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955873920 00000100:00100000:1.0:1789176582.256602:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955873920 00000100:00100000:1.0:1789176582.256614:0:25231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955874432 00000100:00100000:1.0:1789176582.256616:0:25231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955874432 00000100:00100000:1.0:1789176582.256632:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176582.256639:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955874048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:2.0:1789176582.256660:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176582.256665:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176582.256686:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955874048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 46us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176582.256694:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176582.256706:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1789176582.256713:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bebb23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955874560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176582.256747:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bebb23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955874560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176582.256755:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1789176582.256962:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1789176582.256971:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955873920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176582.257001:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2b36a1ad-41a8-406e-85d7-4063c4e2797a+5:2389:x1876086955873920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176582.257008:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1789176582.257020:0:25231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176582.257029:0:25231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955874432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176582.257055:0:25231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:852aa205-2094-4994-8a68-4550c04d9105+5:2389:x1876086955874432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176582.257061:0:25231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00010000:00010000:1.0:1789176582.834103:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13905 lines, 13905 kept, 0 dropped, 0 bad.