00000100:00100000:0.0F:1787862993.052363:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526509312:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.052484:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1787862993.052773:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526508928:0@lo:400:kworker.0 00000100:00100000:1.0:1787862993.052823:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862993.057418:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526509056:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.057543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862993.057606:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526509568:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.057635:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862993.057655:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862993.057661:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526509184:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.057691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862993.057731:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509312 00000100:00100000:0.0:1787862993.057742:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509312 00000100:00100000:0.0:1787862993.057793:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509568 00000100:00100000:0.0:1787862993.057796:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509568 00000100:00100000:0.0:1787862993.057821:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787862993.057830:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526509312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.057893:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526509312:12345-0@lo:400:kworker.0 Request processed in 64us (5410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862993.057902:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787862993.057920:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787862993.057925:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526509568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.057955:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526509568:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862993.057961:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787862993.057976:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509056 00000100:00100000:0.0:1787862993.057979:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509056 00000100:00100000:0.0:1787862993.058001:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509184 00000100:00100000:0.0:1787862993.058003:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509184 00000100:00100000:0.0:1787862993.058031:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787862993.058082:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526509056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.058120:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526509056:12345-0@lo:400:kworker.0 Request processed in 40us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862993.058127:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787862993.058137:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787862993.058142:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526509184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.058164:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526509184:12345-0@lo:400:kworker.0 Request processed in 22us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862993.058169:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1787862993.058193:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862993.058197:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862993.058200:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862993.058234:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526509312:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.058269:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526509184:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.058277:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526509056:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.058285:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526509568:0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.058354:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526509696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862993.058397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862993.058430:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509696 00000100:00100000:0.0:1787862993.058434:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509696 00000100:00100000:0.0:1787862993.058458:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862993.058465:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526509696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862993.058500:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862993.058534:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526509696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862993.058546:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862993.058574:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526509696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862993.074730:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526509440:0@lo:400:kworker.0 00000100:00100000:1.0:1787862993.074811:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862993.075315:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509440 00000100:00100000:0.0:1787862993.075324:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509440 00000100:00100000:0.0:1787862993.075402:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787862993.075412:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526509440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862993.075486:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526509440:12345-0@lo:400:kworker.0 Request processed in 75us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862993.075493:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787862993.075550:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526509440:0@lo:400:kworker.0 00000100:00100000:3.0F:1787862993.076246:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508928 00000100:00100000:3.0:1787862993.076259:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508928 00000100:00100000:3.0:1787862993.076294:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787862993.076301:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526508928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862993.076344:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526508928:12345-0@lo:400:kworker.0 Request processed in 44us (23522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862993.076351:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1787862993.077843:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862993.080120:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526508928:0@lo:400:kworker.0 00010000:00010000:3.0:1787862993.319175:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862994.083459:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526509824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862994.083568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862994.083716:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509824 00000100:00100000:0.0:1787862994.083727:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509824 00000100:00100000:0.0:1787862994.083793:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787862994.083805:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526509824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862994.083856:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862994.083905:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526509824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862994.083913:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787862994.083974:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526509824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0F:1787862994.333001:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862995.357287:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862995.748841:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862995.748855:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862995.749438:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862995.749451:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862996.284882:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862996.284997:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080576 00000100:00100000:2.0:1787862996.285019:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080576 00000100:00100000:2.0:1787862996.285156:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00080000:1.0:1787862996.285160:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862996.285170:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14403:x1874709517080576:12345-192.168.202.60@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787862996.285482:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14403:x1874709517080576:12345-192.168.202.60@tcp:60:lhsmtool_posix.0 Request processed in 315us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862996.285490:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:2.0:1787862996.293567:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862996.293705:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080832 00000100:00100000:3.0:1787862996.293721:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080832 00000100:00100000:3.0:1787862996.293808:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:3.0:1787862996.293822:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14403:x1874709517080832:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787862996.294469:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:14403:x1874709517080832:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 648us (912us total) trans 8589934672 rc 0/0 00000100:00100000:3.0:1787862996.294479:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00010000:00010000:2.0:1787862996.385929:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862997.194457:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862997.194691:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080960 00000100:00100000:2.0:1787862997.194707:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080960 00000100:00100000:2.0:1787862997.194795:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:2.0:1787862997.194808:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517080960:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862997.194936:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517080960:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 131us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862997.194947:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:1.0:1787862997.197908:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862997.197977:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862997.198032:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862997.198228:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081216 00000100:00100000:0.0:1787862997.198244:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081216 00000100:00100000:3.0:1787862997.198306:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081088 00000100:00100000:3.0:1787862997.198312:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081088 00000100:00100000:0.0:1787862997.198360:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:3.0:1787862997.198367:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081344 00000100:00100000:3.0:1787862997.198370:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081344 00000100:00100000:0.0:1787862997.198377:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517081216:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862997.198397:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 242 00000100:00100000:3.0:1787862997.198405:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:2347:x1874709517081088:12345-192.168.202.60@tcp:400:kworker.0 00000100:00080000:1.0:1787862997.198500:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862997.198520:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862997.198523:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:2347:x1874709517081088:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 116us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862997.198532:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 242 00000100:00100000:3.0:1787862997.198580:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 243 00000100:00100000:3.0:1787862997.198586:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517081344:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862997.198867:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517081216:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 492us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862997.198875:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:3.0:1787862997.205864:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517081344:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 7249us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862997.205899:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 243 00010000:00010000:2.0:1787862997.404850:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862998.174536:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526509952:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.174801:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526510336:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.174955:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862998.175143:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526510080:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.175212:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862998.175246:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526510592:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.175279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862998.176892:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862998.177001:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526510464:0@lo:400:kworker.0 00000100:00100000:3.0:1787862998.177147:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526509952 00000100:00100000:3.0:1787862998.177163:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526509952 00000100:00100000:3.0:1787862998.177248:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787862998.177264:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526509952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862998.177375:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526509952:12345-0@lo:400:kworker.0 Request processed in 114us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862998.177387:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787862998.182167:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526510208:0@lo:400:kworker.0 00000100:00100000:2.0:1787862998.184068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862998.185955:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510080 00000100:00100000:2.0:1787862998.185981:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510080 00000100:00100000:2.0:1787862998.186093:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510208 00000100:00100000:2.0:1787862998.186099:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510208 00000100:00100000:2.0:1787862998.186142:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787862998.186158:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d3f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526510080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862998.186337:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d3f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526510080:12345-0@lo:400:kworker.0 Request processed in 177us (11119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862998.187176:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787862998.187198:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526510208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.187313:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526510208:12345-0@lo:400:kworker.0 Request processed in 122us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862998.187324:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787862998.187372:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510336 00000100:00100000:0.0:1787862998.187383:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510336 00000100:00100000:0.0:1787862998.188591:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510592 00000100:00100000:0.0:1787862998.188605:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510592 00000100:00100000:0.0:1787862998.188665:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787862998.188691:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526510336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.188820:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526510336:12345-0@lo:400:kworker.0 Request processed in 134us (13866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862998.188856:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787862998.188878:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787862998.188884:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526510592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.188925:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526510592:12345-0@lo:400:kworker.0 Request processed in 42us (13645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862998.188932:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787862998.189022:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526510336:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.189141:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526510208:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.189185:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526510592:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.189213:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526510080:0@lo:400:kworker.0 00000100:00100000:0.0:1787862998.189351:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526510720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862998.189418:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862998.189463:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510720 00000100:00100000:0.0:1787862998.189469:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510720 00000100:00100000:0.0:1787862998.189499:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862998.189506:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526510720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862998.189544:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862998.189593:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526510720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862998.189600:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862998.189648:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526510720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862998.190732:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1787862998.191238:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862998.191259:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862998.191263:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862998.199846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862998.200110:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526509952:0@lo:400:kworker.0 00000100:00100000:1.0:1787862998.206175:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510464 00000100:00100000:1.0:1787862998.206205:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510464 00000100:00100000:1.0:1787862998.206363:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787862998.206379:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526510464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862998.206889:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526510464:12345-0@lo:400:kworker.0 Request processed in 512us (7056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862998.206900:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787862998.207103:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862998.208002:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526510464:0@lo:400:kworker.0 00010000:00010000:2.0:1787862998.429245:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862999.200410:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862999.200454:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526510848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862999.200587:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862999.201723:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510848 00000100:00100000:0.0:1787862999.201756:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510848 00000100:00100000:0.0:1787862999.201824:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787862999.201836:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526510848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862999.204437:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862999.204590:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526510848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2751us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862999.204605:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787862999.206012:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526510848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862999.452466:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863000.476300:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787863000.944211:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934672 is committed 00010000:00010000:0.0:1787863001.502817:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863002.324277:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863002.324357:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863002.324395:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863002.324428:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863002.324465:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081728 00000100:00100000:0.0:1787863002.324478:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081728 00000100:00100000:0.0:1787863002.324563:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:0.0:1787863002.324577:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517081728:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787863002.324709:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517081728:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 134us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863002.324718:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:0.0:1787863002.324748:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081600 00000100:00100000:0.0:1787863002.324752:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081600 00000100:00100000:0.0:1787863002.324782:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081856 00000100:00100000:0.0:1787863002.324785:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081856 00000100:00100000:0.0:1787863002.324816:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 247 00000100:00100000:0.0:1787863002.324824:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517081600:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787863002.324858:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517081600:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863002.324890:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 247 00000100:00100000:0.0:1787863002.324905:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 248 00000100:00100000:0.0:1787863002.324911:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517081856:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787863002.324940:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517081856:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863002.324946:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 248 00000100:00080000:0.0:1787863002.324972:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787863002.324979:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787863002.325108:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081472 00000100:00100000:2.0:1787863002.325114:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081472 00000100:00100000:2.0:1787863002.325151:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 209 00000100:00100000:2.0:1787863002.325159:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517081472:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863002.325192:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517081472:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863002.325199:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 209 00010000:00010000:2.0:1787863002.524279:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863003.292554:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526510976:0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.292684:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863003.292757:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526511488:0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.292806:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863003.292843:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787863003.292851:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526511360:0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.292878:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863003.292921:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526510976 00000100:00100000:3.0:1787863003.292931:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526510976 00000100:00100000:3.0:1787863003.292995:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787863003.293007:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526510976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.293126:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526510976:12345-0@lo:400:kworker.0 Request processed in 121us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863003.293137:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787863003.293181:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511488 00000100:00100000:3.0:1787863003.293186:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511488 00000100:00100000:3.0:1787863003.293226:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511360 00000100:00100000:3.0:1787863003.293229:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511360 00000100:00100000:3.0:1787863003.293249:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787863003.293255:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526511488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.293370:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526511488:12345-0@lo:400:kworker.0 Request processed in 113us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863003.293377:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787863003.293391:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787863003.293398:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526511360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.293429:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526511360:12345-0@lo:400:kworker.0 Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863003.293436:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:3.0:1787863003.293461:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787863003.293514:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526511360:0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.293539:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526510976:0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.293550:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526511488:0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294118:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526511104:0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863003.294199:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526511616:0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294226:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863003.294245:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787863003.294251:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526511232:0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294301:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863003.294381:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511104 00000100:00100000:0.0:1787863003.294386:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511104 00000100:00100000:0.0:1787863003.294429:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511232 00000100:00100000:0.0:1787863003.294432:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511232 00000100:00100000:0.0:1787863003.294456:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787863003.294465:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526511104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294503:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526511104:12345-0@lo:400:kworker.0 Request processed in 40us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863003.294511:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787863003.294525:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787863003.294543:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526511232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294572:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526511232:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863003.294579:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787863003.294622:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526511744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863003.294650:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863003.294696:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511744 00000100:00100000:0.0:1787863003.294700:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511744 00000100:00100000:0.0:1787863003.294726:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787863003.294733:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526511744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787863003.294765:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863003.294805:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526511744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863003.294812:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787863003.294853:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526511744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863003.294886:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526511232:0@lo:400:kworker.0 00000100:00100000:0.0:1787863003.294897:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526511104:0@lo:400:kworker.0 00000100:00080000:3.0:1787863003.300476:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787863003.300494:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787863003.300525:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511616 00000100:00100000:3.0:1787863003.300543:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511616 00000100:00100000:3.0:1787863003.300649:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787863003.300663:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526511616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863003.300817:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526511616:12345-0@lo:400:kworker.0 Request processed in 156us (6589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863003.300826:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1787863003.300855:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787863003.300907:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526511616:0@lo:400:kworker.0 00010000:00010000:0.0:1787863003.549621:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863004.318634:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787863004.318685:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526511872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787863004.318803:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863004.319073:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526511872 00000100:00100000:1.0:1787863004.319084:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526511872 00000100:00100000:1.0:1787863004.319165:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787863004.319177:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526511872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787863004.319438:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787863004.319560:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526511872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 384us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863004.319570:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787863004.327673:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526511872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787863004.581404:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863005.604459:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787863005.982725:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787863005.982738:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787863005.983311:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787863005.983323:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787863006.622693:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863007.438868:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863007.438926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863007.438961:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863007.438999:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863007.439071:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082112 00000100:00100000:0.0:1787863007.439086:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082112 00000100:00100000:0.0:1787863007.439163:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082368 00000100:00100000:0.0:1787863007.439167:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082368 00000100:00100000:0.0:1787863007.439195:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 252 00000100:00100000:0.0:1787863007.439207:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517082112:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787863007.439316:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517082112:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863007.439327:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 252 00000100:00100000:0.0:1787863007.439349:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 253 00000100:00100000:0.0:1787863007.439356:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517082368:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863007.439608:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517081984 00000100:00100000:3.0:1787863007.439614:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517081984 00000100:00100000:3.0:1787863007.439646:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:3.0:1787863007.439655:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517081984:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863007.439687:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517081984:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863007.439694:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:0.0:1787863007.439761:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517082368:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 403us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863007.439767:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 253 00000100:00080000:0.0:1787863007.439797:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787863007.440396:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082240 00000100:00100000:1.0:1787863007.440404:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082240 00000100:00100000:1.0:1787863007.440478:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 144 00000100:00100000:1.0:1787863007.440491:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517082240:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863007.440557:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517082240:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 61us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863007.440564:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 144 00000100:00080000:3.0:1787863007.440763:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787863007.657673:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863008.412393:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787863008.412445:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526512000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787863008.412588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863008.412703:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512000 00000100:00100000:3.0:1787863008.412716:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512000 00000100:00100000:3.0:1787863008.412807:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787863008.412819:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526512000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787863008.412879:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787863008.412944:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526512000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863008.412954:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787863008.412983:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787863008.413114:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526512000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787863008.413249:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526512128:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413301:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863008.413333:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526512640:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413368:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863008.413395:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787863008.413402:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526512256:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413434:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863008.413475:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512128 00000100:00100000:3.0:1787863008.413482:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512128 00000100:00100000:3.0:1787863008.413519:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787863008.413528:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526512128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413584:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526512128:12345-0@lo:400:kworker.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863008.413616:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787863008.413651:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512640 00000100:00100000:3.0:1787863008.413654:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512640 00000100:00100000:3.0:1787863008.413696:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787863008.413703:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526512640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413736:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526512640:12345-0@lo:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863008.413743:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787863008.413765:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512256 00000100:00100000:3.0:1787863008.413769:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512256 00000100:00100000:3.0:1787863008.413802:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787863008.413809:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526512256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413844:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526512256:12345-0@lo:400:kworker.0 Request processed in 36us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863008.413852:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787863008.413885:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787863008.413890:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787863008.413910:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526512256:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413920:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526512128:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413930:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526512640:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413959:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526512384:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.413987:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863008.414009:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787863008.414015:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526512512:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.414040:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863008.414109:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512384 00000100:00100000:3.0:1787863008.414113:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512384 00000100:00100000:3.0:1787863008.414134:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512512 00000100:00100000:3.0:1787863008.414137:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512512 00000100:00100000:3.0:1787863008.414158:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787863008.414164:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526512384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.414201:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526512384:12345-0@lo:400:kworker.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863008.414208:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787863008.414219:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787863008.414225:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526512512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.414253:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526512512:12345-0@lo:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863008.414260:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:3.0:1787863008.414280:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787863008.414298:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526512512:0@lo:400:kworker.0 00000100:00100000:3.0:1787863008.414308:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526512384:0@lo:400:kworker.0 00010000:00010000:1.0:1787863008.668442:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863009.437932:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526512768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863009.438087:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863009.438399:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512768 00000100:00100000:1.0:1787863009.438410:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512768 00000100:00100000:1.0:1787863009.438477:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787863009.438489:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526512768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787863009.438548:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787863009.438612:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526512768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863009.438622:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787863009.439085:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526512768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787863009.694271:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863010.721937:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863011.740580:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787863012.147662:0:22152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:36:49 (1787863009) 00000100:00100000:2.0:1787863012.558174:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863012.558217:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863012.558293:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863012.558656:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863012.558694:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082624 00000100:00100000:2.0:1787863012.558705:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082624 00000100:00100000:2.0:1787863012.558770:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082880 00000100:00100000:2.0:1787863012.558774:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082880 00000100:00100000:2.0:1787863012.558801:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 257 00000100:00100000:2.0:1787863012.558823:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517082624:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863012.558903:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517082624:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 81us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863012.558912:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 257 00000100:00100000:2.0:1787863012.558930:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 258 00000100:00100000:2.0:1787863012.558936:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517082880:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863012.558960:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517082880:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863012.558966:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 258 00000100:00100000:2.0:1787863012.558987:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082496 00000100:00100000:2.0:1787863012.558991:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082496 00000100:00100000:2.0:1787863012.559018:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:2.0:1787863012.559024:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517082496:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863012.559078:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517082496:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 53us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863012.559085:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00080000:2.0:1787863012.559114:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787863012.565838:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517082752 00000100:00100000:1.0:1787863012.565855:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517082752 00000100:00100000:1.0:1787863012.565941:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 146 00000100:00100000:1.0:1787863012.565954:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517082752:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863012.566077:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517082752:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 126us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863012.566085:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 146 00000100:00080000:1.0:1787863012.566247:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787863012.769712:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863013.532637:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526512896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787863013.532791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863013.533520:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526512896 00000100:00100000:0.0:1787863013.533534:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526512896 00000100:00100000:0.0:1787863013.533617:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787863013.533630:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526512896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787863013.533679:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863013.533755:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526512896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863013.533764:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787863013.534065:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526512896:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787863013.535368:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787863013.535963:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526513408:0@lo:400:kworker.0 00000100:00100000:3.0:1787863013.536081:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526513280:0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536116:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863013.536208:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863013.536258:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787863013.536265:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526513152:0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536302:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863013.536340:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513152 00000100:00100000:1.0:1787863013.536349:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513152 00000100:00100000:1.0:1787863013.536417:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787863013.536431:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536508:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526513152:12345-0@lo:400:kworker.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863013.536517:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1787863013.536544:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787863013.536583:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526513152:0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536731:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787863013.536739:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526513024:0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863013.536803:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526513536:0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536833:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863013.536864:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513024 00000100:00100000:1.0:1787863013.536868:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513024 00000100:00100000:1.0:1787863013.536910:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787863013.536918:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863013.536966:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526513024:12345-0@lo:400:kworker.0 Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863013.536973:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787863013.537009:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526513024:0@lo:400:kworker.0 00000100:00100000:2.0:1787863013.538233:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513408 00000100:00100000:2.0:1787863013.538245:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513408 00000100:00080000:1.0:1787863013.538362:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787863013.538393:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513280 00000100:00100000:2.0:1787863013.538397:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513280 00000100:00100000:0.0:1787863013.538427:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513536 00000100:00100000:0.0:1787863013.538431:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513536 00000100:00100000:0.0:1787863013.538500:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787863013.538509:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526513408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863013.538598:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526513408:12345-0@lo:400:kworker.0 Request processed in 90us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863013.538606:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787863013.538625:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787863013.538632:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526513280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863013.538669:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526513280:12345-0@lo:400:kworker.0 Request processed in 39us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863013.538674:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787863013.538683:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787863013.538687:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526513536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863013.538711:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526513536:12345-0@lo:400:kworker.0 Request processed in 23us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863013.538723:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787863013.538770:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526513280:0@lo:400:kworker.0 00000100:00100000:0.0:1787863013.538799:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526513536:0@lo:400:kworker.0 00000100:00100000:0.0:1787863013.538808:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526513408:0@lo:400:kworker.0 00000100:00080000:1.0:1787863013.539875:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787863013.788585:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863014.558677:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787863014.558714:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526513664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787863014.558820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863014.559307:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513664 00000100:00100000:3.0:1787863014.559318:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513664 00000100:00100000:3.0:1787863014.559398:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787863014.559410:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526513664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787863014.559469:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787863014.559579:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526513664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863014.559588:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787863014.559780:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526513664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787863014.817625:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787863015.198933:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787863015.198951:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787863015.199962:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787863015.199983:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787863015.846565:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863016.860636:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863017.679575:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863017.679640:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863017.679905:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863017.680081:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517083264 00000100:00100000:0.0:1787863017.680098:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517083264 00000100:00100000:0.0:1787863017.680205:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00100000:0.0:1787863017.680220:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517083264:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787863017.680352:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517083264:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 135us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863017.680361:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00080000:1.0:1787863017.680512:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787863017.680906:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517083136 00000100:00100000:3.0:1787863017.680914:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517083136 00000100:00100000:3.0:1787863017.680971:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 262 00000100:00100000:3.0:1787863017.680980:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517083136:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863017.681026:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517083136:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 48us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863017.681034:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 262 00000100:00100000:0.0:1787863017.681298:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863017.681825:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517083008 00000100:00100000:2.0:1787863017.681834:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517083008 00000100:00100000:2.0:1787863017.681892:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:2.0:1787863017.681904:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517083008:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863017.681956:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517083008:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 56us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863017.681964:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:2.0:1787863017.682081:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517083392 00000100:00100000:2.0:1787863017.682086:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517083392 00000100:00100000:2.0:1787863017.682138:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 263 00000100:00100000:2.0:1787863017.682146:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517083392:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863017.682184:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517083392:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 40us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863017.682192:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 263 00000100:00080000:1.0:1787863017.682253:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787863017.884652:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863018.498657:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863018.499354:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517083648 00000100:00100000:0.0:1787863018.499374:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517083648 00000100:00100000:0.0:1787863018.499483:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:0.0:1787863018.499498:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65098fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:16247:x1874709517083648:12345-192.168.202.60@tcp:35:umount.0 00000100:00100000:0.0:1787863018.500808:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65098fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:16247:x1874709517083648:12345-192.168.202.60@tcp:35:umount.0 Request processed in 1302us (2163us total) trans 8589934673 rc 0/0 00000100:00100000:0.0:1787863018.500823:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:1.0:1787863018.512987:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863018.513103:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863018.513308:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517083904 00000100:00100000:3.0:1787863018.513326:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517083904 00000100:00100000:3.0:1787863018.513431:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517084160 00000100:00100000:3.0:1787863018.513435:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517084160 00000100:00100000:3.0:1787863018.513486:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:3.0:1787863018.513499:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+14:2349:x1874709517083904:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787863018.513522:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863018.513557:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422de00/0x9c5536ccf893104b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a61 expref: 14 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863018.513608:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863018.513692:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517083904:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 195us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863018.513701:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:3.0:1787863018.513726:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:3.0:1787863018.513732:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:2349:x1874709517084160:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787863018.513741:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863018.513752:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918600/0x9c5536ccf89310c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b2c expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863018.513763:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863018.513781:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:2349:x1874709517084160:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 51us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863018.513787:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:1.0:1787863018.514309:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863018.515780:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517084032 00000100:00100000:3.0:1787863018.515798:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517084032 00000100:00100000:3.0:1787863018.515895:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1787863018.515909:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:2349:x1874709517084032:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787863018.515931:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863018.515958:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8931052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a8b expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863018.515981:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863018.516101:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:2349:x1874709517084032:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 195us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863018.516216:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:2.0:1787863018.516673:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863018.517119:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517084288 00000100:00100000:0.0:1787863018.517129:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517084288 00000100:00100000:0.0:1787863018.517196:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1787863018.517205:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2345:x1874709517084288:12345-192.168.202.60@tcp:9:umount.0 00000020:00000080:0.0:1787863018.517258:0:16604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf893106e 00000020:00010000:0.0:1787863018.517269:0:16604:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6401bc5800: total 0 00000100:00080000:0.0:1787863018.517276:0:16604:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787863018.517337:0:16604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:0.0:1787863018.517759:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+4:2345:x1874709517084288:12345-192.168.202.60@tcp:9:umount.0 Request processed in 553us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863018.517769:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000020:00010000:0.0:1787863018.517831:0:14302:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6401bc5800: total 0 00010000:00010000:0.0:1787863018.517837:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863018.517889:0:14302:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6401bc5800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1787863018.517938:0:14302:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787863018.517966:0:14302:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787863018.518008:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d628983f/0x9c5536ccf8931656 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ca6 expref: 3 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863018.518088:0:14302:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6401bc5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787863018.518103:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863018.518105:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863018.518107:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863018.538463:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863018.539937:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517085184 00000100:00100000:3.0:1787863018.539960:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517085184 00000100:00100000:3.0:1787863018.540523:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:3.0:1787863018.540542:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:2345:x1874709517085184:12345-192.168.202.60@tcp:39:umount.0 00000020:00000080:3.0:1787863018.540601:0:14315:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8931060 00000020:00010000:3.0:1787863018.540628:0:14315:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a65117b5800: total 0 00000100:00080000:3.0:1787863018.540636:0:14315:0:(import.c:65:import_set_state_nolock()) ffff9a65117b6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787863018.540693:0:14315:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934673 00000020:00010000:1.0:1787863018.540943:0:14303:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a65117b5800: total 0 00010000:00010000:1.0:1787863018.541038:0:14303:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a65117b5800, canceled 0 locks, left on hash table 9. 00000100:00100000:3.0:1787863018.548350:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2345:x1874709517085184:12345-192.168.202.60@tcp:39:umount.0 Request processed in 7798us (9906us total) trans 8589934674 rc 0/0 00000100:00100000:3.0:1787863018.548373:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00010000:00010000:1.0:1787863018.549990:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787863018.550008:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787863018.550025:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550086:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787863018.550090:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787863018.550096:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf893166b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cad expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550143:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a65178bf200) 00010000:00010000:1.0:1787863018.550146:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787863018.550150:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf893112b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b3a expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550174:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:1.0:1787863018.550177:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787863018.550182:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b48 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550196:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:1.0:1787863018.550199:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787863018.550203:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16600/0x9c5536ccf89315fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c83 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550248:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787863018.550252:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787863018.550257:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cc2 expref: 8 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550274:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a65178bfa00) 00010000:00010000:1.0:1787863018.550276:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787863018.550281:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf893110f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b33 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.550295:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787863018.556605:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787863018.556632:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918200/0x9c5536ccf89311e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b72 expref: 6 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.556684:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787863018.556688:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787863018.556693:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637c00/0x9c5536ccf893148f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c2f expref: 5 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863018.556716:0:14303:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a65117b5800, canceled 9 locks, left on hash table 0. 00010000:00010000:1.0:1787863018.556763:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863018.556766:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863018.556769:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863018.652924:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526513920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863018.653028:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863018.653142:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526514432:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.653184:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863018.653221:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787863018.653231:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526514048:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.653283:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863018.653325:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526514560:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.653372:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863018.653427:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526514176:0@lo:400:kworker.0 00000100:00100000:2.0:1787863018.653467:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526513792:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.653470:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863018.653526:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513920 00000100:00100000:0.0:1787863018.653536:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513920 00000100:00100000:2.0:1787863018.653569:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863018.653795:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526514304:0@lo:400:kworker.0 00000100:00100000:2.0:1787863018.653833:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863018.653998:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526513792 00000100:00100000:2.0:1787863018.654005:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526513792 00000100:00100000:2.0:1787863018.654145:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787863018.654158:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863018.654254:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526513792:12345-0@lo:400:kworker.0 Request processed in 98us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863018.654264:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787863018.654318:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514432 00000100:00100000:2.0:1787863018.654323:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514432 00000100:00100000:2.0:1787863018.654361:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514560 00000100:00100000:2.0:1787863018.654365:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514560 00000100:00100000:2.0:1787863018.654380:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514304 00000100:00100000:2.0:1787863018.654382:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514304 00000100:00100000:2.0:1787863018.654395:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787863018.654400:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526514432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863018.654459:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526514432:12345-0@lo:400:kworker.0 Request processed in 58us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863018.654466:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787863018.654479:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787863018.654486:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526514560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863018.654517:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526514560:12345-0@lo:400:kworker.0 Request processed in 32us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863018.657615:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787863018.657655:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526513920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787863018.657734:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863018.657880:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526513920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 250us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863018.657913:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787863018.658504:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787863018.658511:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787863018.659760:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787863018.660670:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787863018.660695:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526514304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.660784:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526514304:12345-0@lo:400:kworker.0 Request processed in 101us (6951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863018.660793:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787863018.660847:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514048 00000100:00100000:0.0:1787863018.660855:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514048 00000100:00100000:0.0:1787863018.660915:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514176 00000100:00100000:0.0:1787863018.660918:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514176 00000100:00100000:0.0:1787863018.660942:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787863018.660948:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526514048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.660985:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526514048:12345-0@lo:400:kworker.0 Request processed in 38us (7706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863018.660992:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787863018.661003:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787863018.661009:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526514176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.661039:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526514176:12345-0@lo:400:kworker.0 Request processed in 31us (7571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863018.661183:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787863018.661234:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526514176:0@lo:400:kworker.0 00000100:00080000:0.0:1787863018.661293:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787863018.661327:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526513792:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.661339:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526514304:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.662800:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526514048:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.662987:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526514560:0@lo:400:kworker.0 00000100:00100000:0.0:1787863018.663011:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526513920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863018.663024:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526514432:0@lo:400:kworker.0 00000001:00100000:0.0:1787863018.763745:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a16fbf5-07bd-4add-b9e9-3111232e9331 00000020:00000080:0.0:1787863018.763756:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a6401bc5800/7a16fbf5-07bd-4add-b9e9-3111232e9331 00000020:00000080:3.0:1787863018.763847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6401bc5800/7a16fbf5-07bd-4add-b9e9-3111232e9331 for lustre-OST0001 00000020:00000080:3.0:1787863018.763911:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6401bc7000 for lustre-OST0001 00010000:00010000:0.0:1787863018.909037:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863019.676748:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787863019.677099:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526514688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787863019.677176:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863019.677565:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514688 00000100:00100000:0.0:1787863019.677576:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514688 00000100:00100000:0.0:1787863019.677639:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787863019.677651:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526514688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787863019.677702:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863019.677759:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526514688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863019.677781:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787863019.678029:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526514688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787863019.934522:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863020.959668:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863021.167789:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863021.167836:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863021.167942:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517085312 00000100:00100000:0.0:1787863021.167955:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517085312 00000100:00100000:0.0:1787863021.168025:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517085440 00000100:00100000:0.0:1787863021.168029:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517085440 00000100:00100000:0.0:1787863021.168095:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787863021.168109:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:2348:x1874709517085312:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787863021.168370:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863021.168394:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd600/0x9c5536ccf8931083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ac3 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863021.168443:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787863021.168524:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:2348:x1874709517085312:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 418us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863021.168533:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787863021.168553:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1787863021.168560:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+9:2349:x1874709517085440:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787863021.168569:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863021.168577:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919400/0x9c5536ccf893108a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34aed expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863021.168585:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787863021.168604:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:2349:x1874709517085440:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 45us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863021.168609:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1787863021.191228:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863021.191527:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517085568 00000100:00100000:0.0:1787863021.191537:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517085568 00000100:00100000:0.0:1787863021.191607:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:0.0:1787863021.191618:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:2349:x1874709517085568:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787863021.191638:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863021.191659:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918e00/0x9c5536ccf89310c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b25 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863021.191677:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787863021.191741:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+7:2349:x1874709517085568:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 124us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863021.191765:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787863021.199973:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863021.200135:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517085824 00000100:00100000:0.0:1787863021.200150:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517085824 00000100:00100000:3.0:1787863021.200672:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:3.0:1787863021.200687:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2345:x1874709517085824:12345-192.168.202.60@tcp:39:umount.0 00000020:00000080:3.0:1787863021.200736:0:14315:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8931098 00000020:00010000:3.0:1787863021.200746:0:14315:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6401bc0800: total 0 00000100:00080000:3.0:1787863021.200752:0:14315:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787863021.200804:0:14315:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934674 00000100:00100000:3.0:1787863021.201114:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2345:x1874709517085824:12345-192.168.202.60@tcp:39:umount.0 Request processed in 429us (1153us total) trans 8589934675 rc 0/0 00000100:00100000:3.0:1787863021.201123:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00080000:1.0:1787863021.201544:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1787863021.201677:0:14303:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6401bc0800: total 0 00010000:00010000:2.0:1787863021.201698:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863021.201742:0:14303:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6401bc0800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787863021.201783:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787863021.201786:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787863021.201794:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf8931171 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b4f expref: 4 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863021.201815:0:14303:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6401bc0800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787863021.201824:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863021.201826:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863021.201827:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863021.230035:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863021.230096:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086080 00000100:00100000:3.0:1787863021.230115:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086080 00000100:00100000:3.0:1787863021.230179:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:3.0:1787863021.230192:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+7:2345:x1874709517086080:12345-192.168.202.60@tcp:251:umount.0 00000020:00000080:3.0:1787863021.230239:0:14308:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf893103d 00000020:00010000:3.0:1787863021.230247:0:14308:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a65117b1800: total 0 00000100:00080000:3.0:1787863021.230251:0:14308:0:(import.c:65:import_set_state_nolock()) ffff9a65117b4800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787863021.230314:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+3:2345:x1874709517086080:12345-192.168.202.60@tcp:251:umount.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863021.230323:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 217 00000020:00010000:3.0:1787863021.230407:0:14302:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a65117b1800: total 0 00010000:00010000:3.0:1787863021.230463:0:14302:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a65117b1800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787863021.230500:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfc000/0x9c5536ccf8931044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a5a expref: 2 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863021.230516:0:14302:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a65117b1800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787863021.230525:0:14302:0:(genops.c:885:class_export_put()) final put ffff9a65117b1800/ec424a92-b33b-4ce7-b36b-6c8bccbb8254 00010000:00010000:3.0:1787863021.230537:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863021.230539:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863021.230541:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787863021.230640:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65117b1800/ec424a92-b33b-4ce7-b36b-6c8bccbb8254 for MGS 00000020:00000080:3.0:1787863021.230672:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65117b4800 for MGS 00000001:00080000:0.0:1787863021.305765:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934673 is committed 00000001:00100000:0.0:1787863021.305794:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000001:00080000:0.0:1787863021.305801:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00000080:0.0:1787863021.305805:0:5837:0:(genops.c:885:class_export_put()) final put ffff9a6401bc0800/1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000001:00100000:0.0:1787863021.305833:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a16fbf5-07bd-4add-b9e9-3111232e9331 00000001:00080000:0.0:1787863021.305843:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00000080:0.0:1787863021.305845:0:5837:0:(genops.c:885:class_export_put()) final put ffff9a65117b5800/7a16fbf5-07bd-4add-b9e9-3111232e9331 00000020:00000080:2.0:1787863021.305910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6401bc0800/1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf for lustre-MDT0000 00000020:00000080:2.0:1787863021.305992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65117b5800/7a16fbf5-07bd-4add-b9e9-3111232e9331 for lustre-MDT0000 00000020:00000080:2.0:1787863021.306023:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6401bc6000 for lustre-MDT0000 00000020:00000080:2.0:1787863021.306029:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65117b6800 for lustre-MDT0000 00010000:00010000:2.0:1787863021.980192:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.006328:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787863023.748801:0:22351:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787863023.768707:0:22351:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787863023.768764:0:22351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.768780:0:22351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.768787:0:22351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.768810:0:22351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.768836:0:22351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787863023.768842:0:22351:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787863023.768866:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787863023.768871:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787863023.768877:0:22351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787863023.768903:0:22351:0:(import.c:65:import_set_state_nolock()) ffff9a65081c4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787863023.769071:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526514816:0@lo:39:umount.0 00000100:00100000:0.0:1787863023.769153:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787863023.769323:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787863023.769331:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.769339:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918a00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787863023.769343:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.769352:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787863023.769359:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787863023.769376:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787863023.769379:0:14303:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787863023.769381:0:14303:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787863023.769420:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.769427:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787863023.769452:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.769460:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.769471:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863023.769472:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863023.769474:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863023.769531:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514816 00000100:00100000:3.0:1787863023.769540:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514816 00000100:00100000:3.0:1787863023.769593:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787863023.769603:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874709526514816:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787863023.769684:0:15473:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d9d 00000100:00080000:3.0:1787863023.769693:0:15473:0:(import.c:65:import_set_state_nolock()) ffff9a65091a2000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787863023.769755:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3280:x1874709526514816:12345-0@lo:39:umount.0 Request processed in 154us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863023.769763:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000020:00000080:3.0:1787863023.769771:0:15473:0:(genops.c:885:class_export_put()) final put ffff9a65347db800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1787863023.769849:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526514944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787863023.769881:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787863023.769949:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65081c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787863023.769959:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526514816:0@lo:39:umount.0 00000100:00100000:2.0:1787863023.770012:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526514944 00000100:00100000:2.0:1787863023.770016:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526514944 00000100:00100000:2.0:1787863023.770082:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787863023.770090:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526514944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787863023.770101:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787863023.770117:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534637200/0x9c5536ccf8930d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930d6c expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.770129:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787863023.770160:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:3284:x1874709526514944:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863023.770166:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787863023.770243:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526514944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787863023.770721:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787863023.770731:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787863023.770735:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787863023.770740:0:22351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787863023.772174:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526515072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863023.772248:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863023.772305:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515072 00000100:00100000:0.0:1787863023.772313:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515072 00010000:00010000:3.0:1787863023.772575:0:22351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772588:0:22351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772608:0:22351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772624:0:22351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772647:0:22351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787863023.772653:0:22351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772661:0:22351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772666:0:22351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772671:0:22351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772683:0:22351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787863023.772695:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787863023.772700:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772707:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637e00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787863023.772711:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772719:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863023.772734:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863023.772740:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787863023.772743:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787863023.772766:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772772:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787863023.772786:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772793:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772804:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787863023.772807:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772812:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787863023.772814:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772819:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863023.772824:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863023.772829:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787863023.772836:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787863023.772838:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787863023.772852:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772858:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787863023.772871:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772877:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772889:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.772891:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.772893:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.772904:0:22351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772911:0:22351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772916:0:22351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772921:0:22351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772931:0:22351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787863023.772936:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787863023.772939:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772954:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787863023.772957:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772964:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863023.772969:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863023.772974:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787863023.772976:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787863023.772977:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787863023.772992:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.772997:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787863023.773003:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773008:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773016:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.773018:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.773019:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.773028:0:22351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773184:0:22351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773197:0:22351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773204:0:22351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773217:0:22351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787863023.773220:0:22351:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787863023.773222:0:22351:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787863023.773244:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787863023.773248:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773254:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637a00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787863023.773257:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773263:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863023.773269:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863023.773273:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787863023.773276:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787863023.773277:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787863023.773292:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773297:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787863023.773310:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773316:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.773327:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.773329:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863023.773331:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787863023.773346:0:22351:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787863023.773350:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787863023.773355:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787863023.773360:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787863023.773366:0:22351:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a652731d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787863023.773372:0:22351:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6507419000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787863023.773377:0:22351:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a6533ee8000) has exports, disconnecting them 00000020:00080000:3.0:1787863023.773382:0:22351:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a652731d000), last request at 1787863018 00000020:00000080:3.0:1787863023.773390:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930f56 00000100:00080000:3.0:1787863023.773415:0:22351:0:(import.c:65:import_set_state_nolock()) ffff9a652731f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787863023.773449:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787863023.773460:0:22351:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a652731d000): rc 0 00000020:00000080:3.0:1787863023.773462:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a652731d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787863023.773469:0:22351:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6507419000), last request at 1787863018 00000020:00000080:3.0:1787863023.773472:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930e22 00000100:00080000:3.0:1787863023.773477:0:22351:0:(import.c:65:import_set_state_nolock()) ffff9a650741e000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787863023.773485:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787863023.773490:0:22351:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6507419000): rc 0 00000020:00000080:3.0:1787863023.773492:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6507419000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787863023.773499:0:22351:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf1501c57ae0 00000100:00080000:3.0:1787863023.773518:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787863023.773526:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 3 00010000:00010000:2.0:1787863023.773596:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787863023.773997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65347db800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1787863023.774077:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: FULL) 00000020:00000080:1.0:1787863023.774108:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a652731d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787863023.774127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6507419000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787863023.774151:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65091a2000 for lustre-MDT0000 00000020:00000080:1.0:1787863023.774156:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a652731f800 for lustre-MDT0000 00000020:00000080:1.0:1787863023.774159:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a650741e000 for lustre-MDT0000 00000100:00100000:0.0:1787863023.775923:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787863023.775940:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526515072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787863023.775985:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787863023.776132:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787863023.776261:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526515200:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1787863023.776328:0:22351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787863023.776402:0:22351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787863023.776425:0:22351:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787863023.776444:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787863023.776452:0:22351:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a651fc883c0 x1874709526515072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787863039 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863023.776463:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:3.0:1787863023.776473:0:22351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787863023.776527:0:22351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787863023.776536:0:22351:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787863023.776568:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a6533ee8000) has no exports 00000100:00100000:1.0:1787863023.776821:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863023.776897:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526515712:0@lo:400:kworker.0 00000100:00100000:1.0:1787863023.776927:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863023.776961:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787863023.776967:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526515584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863023.776988:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863023.777021:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515712 00000100:00100000:2.0:1787863023.777028:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515712 00000100:00100000:2.0:1787863023.777083:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787863023.777089:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1874709526515712:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787863023.777095:0:14315:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787863023.777132:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1874709526515712:12345-0@lo:400:kworker.0 Request processed in 42us (204us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787863023.777139:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787863023.777262:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526515072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1327us (5013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863023.777269:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787863023.777298:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526515328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787863023.777330:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526515456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787863023.777354:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526515968:0@lo:9:umount.0 00000100:00100000:0.0:1787863023.777378:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863023.777416:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526516096:0@lo:9:umount.0 00000100:00100000:0.0:1787863023.777438:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863023.777469:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515968 00000100:00100000:0.0:1787863023.777472:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515968 00000100:00100000:0.0:1787863023.777505:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526516096 00000100:00100000:0.0:1787863023.777508:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526516096 00000100:00100000:0.0:1787863023.777528:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787863023.777535:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874709526515968:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787863023.777560:0:14998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930e3e 00000100:00080000:0.0:1787863023.777570:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a6534624000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787863023.777616:0:14998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787863023.777959:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3280:x1874709526515968:12345-0@lo:9:umount.0 Request processed in 424us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863023.777966:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787863023.777977:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787863023.777983:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874709526516096:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787863023.777995:0:14998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930f72 00000100:00080000:0.0:1787863023.778001:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a652731b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787863023.778019:0:14998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:0.0:1787863023.778283:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3280:x1874709526516096:12345-0@lo:9:umount.0 Request processed in 300us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863023.778290:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787863023.778309:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787863023.778328:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863023.778353:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787863023.778385:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787863023.778404:0:3280:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787863023.778406:0:3280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787863023.778410:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526515968:0@lo:9:umount.0 00000100:00080000:0.0:1787863023.778421:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787863023.778430:0:3280:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787863023.778432:0:3280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787863023.778434:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526516096:0@lo:9:umount.0 00000100:00100000:0.0:1787863023.779701:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526515072:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787863023.779885:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787863023.779891:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787863023.779895:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787863023.783282:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515200 00000100:00100000:3.0:1787863023.783298:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515200 00000100:00100000:3.0:1787863023.783378:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515584 00000100:00100000:3.0:1787863023.783382:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515584 00000100:00100000:3.0:1787863023.783437:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787863023.783448:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526515200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787863023.783469:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863023.783491:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422d400/0x9c5536ccf8930cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930cd2 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.783510:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863023.783592:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:3282:x1874709526515200:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (6770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863023.783600:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787863023.783618:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787863023.783624:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:3282:x1874709526515584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787863023.783649:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863023.783658:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422d800/0x9c5536ccf8930ccb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930cc4 expref: 17 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.783670:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863023.783694:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3282:x1874709526515584:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (6704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863023.783700:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787863023.784335:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863023.784515:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515456 00000100:00100000:2.0:1787863023.784522:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515456 00000100:00100000:2.0:1787863023.784558:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787863023.784566:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3284:x1874709526515456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787863023.784576:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787863023.784589:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534636e00/0x9c5536ccf89310f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf89310ec expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863023.784599:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787863023.784639:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:3284:x1874709526515456:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863023.784646:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787863023.784682:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526515456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787863023.787748:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863023.787812:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526515840:0@lo:400:kworker.0 00000100:00100000:0.0:1787863023.787874:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863023.787930:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515840 00000100:00100000:0.0:1787863023.787938:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515840 00000100:00100000:0.0:1787863023.787980:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787863023.787988:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1874709526515840:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787863023.787996:0:14316:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787863023.788124:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1874709526515840:12345-0@lo:400:kworker.0 Request processed in 44us (157us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787863023.788134:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787863023.788182:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787863023.788188:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787863023.788204:0:3283:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787863023.788210:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787863023.788213:0:3283:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1787863023.788219:0:3283:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6401bc1800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787863023.788251:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651fc61e00 x1874709526516224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787863023.788275:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526515840:0@lo:400:kworker.0 00000100:00100000:0.0:1787863023.788299:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526516224:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787863023.788330:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863023.788360:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526516224 00000100:00100000:0.0:1787863023.788363:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526516224 00000100:00100000:0.0:1787863023.788381:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787863023.788386:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3280:x1874709526516224:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787863023.795282:0:14315:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1787863023.796937:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787863023.796951:0:3282:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1787863023.796966:0:3282:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a653e4b3000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787863023.798446:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651682ad00 x1874709526516352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787863023.798558:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526516352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787863023.798670:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863023.798754:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526515712:0@lo:400:kworker.0 00000100:00100000:1.0:1787863023.798810:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526515584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863023.798823:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526515200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863023.799137:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526516352 00000100:00100000:1.0:1787863023.799147:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526516352 00000100:00100000:1.0:1787863023.799202:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787863023.799212:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526516352:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787863023.799237:0:14314:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787863023.802246:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526516352:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 3018us (3561us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787863023.802294:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787863023.802328:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526515328 00000100:00100000:3.0:1787863023.802344:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526515328 00000100:00100000:3.0:1787863023.802448:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787863023.802464:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:3283:x1874709526515328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787863023.802486:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863023.802511:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919200/0x9c5536ccf8930f6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930f64 expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863023.802541:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863023.802670:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:3283:x1874709526515328:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (14929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863023.802679:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787863023.805895:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526515328:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787863023.806721:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787863023.806730:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787863023.806734:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526516352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787863023.816704:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3280:x1874709526516224:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28306us (28363us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787863023.816719:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1787863023.819948:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787863023.819965:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787863023.819971:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526516224:0@lo:38:ptlrpcd_00_02.0 00000020:00080000:0.0:1787863023.822468:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a6533ee8000) has no exports 00000020:00000080:0.0:1787863023.895682:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d1f 00000020:00000080:0.0:1787863023.895699:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a65331f0800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787863023.895713:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787863023.896351:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65331f0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787863023.896382:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787863023.896405:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787863023.896409:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a6526ce1a48) has no exports 00000020:00000080:1.0:1787863023.896875:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d18 00000020:00000080:1.0:1787863023.896890:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a651f8d1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787863023.896976:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787863023.896989:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787863023.896993:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a651f8d0000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787863023.896996:0:22351:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651f8d0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787863023.897002:0:22351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787863023.897122:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651f8d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787863023.897225:0:22351:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a653404bcc0 - data ffff9a653e9eea20/ffff9a64031afc00 00000020:01000000:1.0:1787863023.897422:0:22351:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a6509a0c240 - data ffff9a6539f8ae58/ffff9a6527185c00 00000001:00000004:2.0:1787863023.942246:0:22351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934675 00010000:00010000:1.0:1787863024.028375:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787863024.056456:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787863024.056467:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 4 00000004:00080000:2.0:1787863024.056530:0:22351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787863024.056533:0:22351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787863024.059615:0:14337:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787863024.059623:0:14337:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 3 count 1 00000040:00080000:0.0:1787863024.059637:0:14337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787863024.062894:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787863024.062902:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1787863024.062924:0:22351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787863024.062927:0:22351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787863024.063439:0:14339:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787863024.063445:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1787863024.063456:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787863024.156714:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930ce7 00000020:00000080:2.0:1787863024.156731:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6527d3c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787863024.158257:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6527d3c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787863024.159229:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930cfc 00000020:00000080:2.0:1787863024.159241:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6537e6b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787863024.159251:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787863024.159258:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863024.159267:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787863024.159271:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a6533ee9a48) has no exports 00000004:01000000:2.0:1787863024.159468:0:22351:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787863024.159478:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d49 00000020:00000080:2.0:1787863024.159482:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a65331d2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787863024.159486:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787863024.159491:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863024.159496:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787863024.159498:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a65401cb490) has no exports 00000020:00000080:2.0:1787863024.159505:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d42 00000020:00000080:2.0:1787863024.159511:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a653dae9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787863024.160239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537e6b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787863024.160249:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65331d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787863024.160258:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a653dae9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787863024.160758:0:22351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787863024.160763:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787863024.160768:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:2.0:1787863024.160776:0:22351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787863024.160778:0:22351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787863024.160888:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863024.160897:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787863024.160906:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d34 00000020:00000080:2.0:1787863024.160915:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a65081c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787863024.163802:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a653daec000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787863024.163820:0:8:0:(genops.c:885:class_export_put()) final put ffff9a65081c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787863024.163837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65081c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787863024.163846:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787863024.164011:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787863024.164019:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863024.164028:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787863024.164061:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9a651c9d4ed8) has no exports 00000020:00000080:2.0:1787863024.164068:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d2d 00000020:00000080:2.0:1787863024.164075:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6527d3d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787863024.164252:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65081c3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787863024.164259:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6527d3d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787863024.164815:0:22351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787863024.164820:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787863024.164825:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 5 00000004:00080000:2.0:1787863024.164832:0:22351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787863024.164835:0:22351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787863024.164891:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863024.164898:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787863024.164932:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863024.164936:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787863024.164940:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6527d3e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787863024.164943:0:22351:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6527d3e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787863024.164948:0:22351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787863024.165524:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d03 00000020:00000080:2.0:1787863024.165535:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6537e6a800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787863024.165541:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787863024.165547:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863024.165552:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787863024.165556:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a65401c8000) has no exports 00000020:00000080:2.0:1787863024.165576:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863024.165579:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787863024.165582:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d0a 00000020:00000080:2.0:1787863024.165586:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6537e6a000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787863024.165681:0:22351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650ac37800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787863024.165685:0:22351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650ac37800 3 00000020:01000004:2.0:1787863024.165688:0:22351:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a650ac37800 from lustre-MDT0000 00000020:00000080:2.0:1787863024.165713:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863024.165717:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787863024.165720:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6527d3b000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787863024.165723:0:22351:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6527d3b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787863024.165730:0:22351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787863024.165761:0:22351:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787863024.165765:0:22351:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787863024.165768:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787863024.165771:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863024.165774:0:22351:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787863024.165783:0:22351:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a651fe86000 5934abbb-415c-4dd1-a04f-dfe9aec97c5f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787863024.165789:0:22351:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a651c9d0000) has exports, disconnecting them 00000020:00080000:2.0:1787863024.165794:0:22351:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a651fe86000), last request at 1787862711 00000020:00000080:2.0:1787863024.165812:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930caf 00000020:00010000:2.0:1787863024.165816:0:22351:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a651fe86000: total 2 00000100:00080000:2.0:1787863024.165820:0:22351:0:(import.c:65:import_set_state_nolock()) ffff9a651fe80000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787863024.165886:0:22351:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a651fe86000): rc 0 00000020:00080000:2.0:1787863024.165890:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a651c9d0000) has no exports 00000100:00100000:2.0:1787863024.165951:0:14309:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a6534675e00:14309] 2 exiting: rc = 0 00000100:00100000:3.0:1787863024.166212:0:14308:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a6534675800:14308] 1 exiting: rc = 0 00000020:00000080:3.0:1787863024.166256:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c1f5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787863024.166264:0:8:0:(genops.c:885:class_export_put()) final put ffff9a65081c7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787863024.166266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65081c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787863024.166270:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787863024.166346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537e6a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787863024.166351:0:8:0:(genops.c:885:class_export_put()) final put ffff9a6537e6c800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787863024.166353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537e6c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787863024.166356:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787863024.166499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537e6a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1787863024.166577:0:14307:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a6509e24800:14307] 0 exiting: rc = 1 00000100:00100000:2.0:1787863024.166724:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166734:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166739:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166744:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166750:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166756:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166761:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166767:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166773:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166790:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166795:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166803:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166810:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166817:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166823:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166829:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166836:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166841:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166847:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166852:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166858:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166864:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166870:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166875:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166886:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166893:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166899:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166905:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166912:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166918:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166923:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166928:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166934:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166940:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166946:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166952:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166957:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166963:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166969:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166975:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166981:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166987:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.166999:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167005:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167019:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167025:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167031:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167037:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167494:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167503:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167508:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167514:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167520:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167526:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167532:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167538:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167543:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167550:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167555:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167561:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167568:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167574:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167579:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863024.167585:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787863024.168331:0:22351:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787863024.168337:0:22351:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1787863024.168866:0:14303:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a651fe86000: total 0 00010000:00010000:0.0:1787863024.168873:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863024.168915:0:14303:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a651fe86000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787863024.168949:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b79600/0x9c5536ccf8930dd5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930dce expref: 9 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.168971:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918000/0x9c5536ccf8930f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930f3a expref: 8 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.168982:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b78a00/0x9c5536ccf8930de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930ddc expref: 7 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.168994:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919e00/0x9c5536ccf8930cbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930cb6 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.169005:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422c800/0x9c5536ccf89310d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf89310d0 expref: 5 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.169014:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b79e00/0x9c5536ccf8930e0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930e06 expref: 4 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.169023:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919a00/0x9c5536ccf8930f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf8930f10 expref: 3 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.169066:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422c000/0x9c5536ccf89310e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf89310de expref: 2 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863024.169077:0:14303:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a651fe86000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787863024.169100:0:14303:0:(genops.c:885:class_export_put()) final put ffff9a651fe86000/5934abbb-415c-4dd1-a04f-dfe9aec97c5f 00010000:00010000:0.0:1787863024.169118:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863024.169120:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863024.169130:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787863024.169469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651fe86000/5934abbb-415c-4dd1-a04f-dfe9aec97c5f for MGS 00000020:00000080:2.0:1787863024.169520:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651fe80000 for MGS 00000020:01000000:2.0:1787863024.170543:0:22351:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a653404b300 - data ffff9a65022e0798/ffff9a6403196400 00000020:01000000:2.0:1787863024.170692:0:22351:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a651c060d20 - data ffff9a65137d0360/ffff9a6507e06000 00000020:00000080:2.0:1787863024.171228:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930c93 00000020:00000080:2.0:1787863024.171236:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6503098000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787863024.171251:0:22351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650ac37800 from MGS, refs=2 00000020:01000004:2.0:1787863024.171255:0:22351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650ac37800 2 00000020:01000004:2.0:1787863024.171258:0:22351:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a650ac37800 from MGS 00000020:00000080:2.0:1787863024.171278:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863024.171285:0:22351:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787863024.171288:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a650309e800/MGS 00000020:00000080:2.0:1787863024.171303:0:22351:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650309e800/MGS for MGS 00000020:01000000:2.0:1787863024.171308:0:22351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787863024.171367:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787863024.171372:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863024.171378:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787863024.171385:0:22351:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a6505645000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787863024.171402:0:22351:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9a65401cced8) has exports, disconnecting them 00000020:00080000:2.0:1787863024.171408:0:22351:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a6505645000), last request at 1787862712 00000020:00000080:2.0:1787863024.171412:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930d81 00000020:00080000:2.0:1787863024.171421:0:22351:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6505645000): rc 0 00000020:00000080:2.0:1787863024.171425:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6505645000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787863024.172107:0:22351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787863024.172114:0:22351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787863024.172118:0:22351:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787863024.172125:0:22351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787863024.172273:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787863024.172279:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787863024.172285:0:22351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650ac37800 1 00000020:00000080:3.0:1787863024.172289:0:22351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930c85 00000020:00000080:3.0:1787863024.172295:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a650309b000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787863024.172300:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787863024.172304:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787863024.172308:0:22351:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787863024.172310:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a6533eeced8) has no exports 00000020:00000080:0.0:1787863024.172567:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6503098000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787863024.172592:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6505645000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787863024.172599:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65081c4800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787863024.172605:0:37:0:(genops.c:885:class_export_put()) final put ffff9a65331d7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787863024.172607:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65331d7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787863024.172611:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787863024.172665:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650309b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787863024.231822:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787863024.231838:0:22351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787863024.231845:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a6511517000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787863024.231850:0:22351:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6511517000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787863024.231862:0:22351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787863024.232003:0:22351:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a650ac35000 00000020:01000000:0.0:1787863024.232062:0:22351:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787863024.232067:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787863024.232071:0:22351:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787863024.232076:0:22351:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a640328b490) has no exports 00000100:00100000:0.0:1787863024.232164:0:14315:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a650939fc00:14315] 1 exiting: rc = 0 00000100:00100000:1.0:1787863024.234297:0:14314:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a6526cb9200:14314] 0 exiting: rc = 1 00000100:00100000:1.0:1787863024.234413:0:14316:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a6402085800:14316] 2 exiting: rc = 0 00000100:00100000:3.0:1787863024.236655:0:15473:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a64019c0400:15473] 3 exiting: rc = 0 00000100:00100000:0.0:1787863024.240926:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240941:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240946:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240955:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240960:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240968:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240974:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240980:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240985:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.240996:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241009:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241017:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241076:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241083:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241194:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241206:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241214:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241219:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241227:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241233:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241239:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241246:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241253:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241259:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241265:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241270:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241276:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241281:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241286:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241291:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241299:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241304:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241309:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241314:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241320:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241325:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241331:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241337:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241343:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241348:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241354:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241359:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241365:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241370:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241375:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241381:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241386:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241410:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241416:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241421:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241427:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241433:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241440:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241446:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241452:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241459:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241464:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241470:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241477:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241483:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241490:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241498:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241504:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.241511:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.248558:0:14317:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a6402084200:14317] 0 exiting: rc = 1 00000100:00100000:3.0:1787863024.249023:0:14318:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a6511732800:14318] 1 exiting: rc = 0 00000100:00100000:0.0:1787863024.249440:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249450:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249456:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249464:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249470:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249477:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249483:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249488:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249493:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249499:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249505:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249510:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249514:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249520:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249526:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249531:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249536:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249551:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249556:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249561:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249567:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249573:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249578:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249583:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249599:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249604:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249610:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249615:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249621:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249627:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249632:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249637:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249642:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249648:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249653:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249657:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249662:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249667:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249672:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249678:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249684:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249690:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249696:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249702:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249707:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249712:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249717:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249723:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249728:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249734:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249739:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249743:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249755:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249760:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249765:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249771:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249776:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249782:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249787:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249791:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249796:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249802:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249808:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.249813:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.253384:0:14319:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a6537e27e00:14319] 0 exiting: rc = 1 00000100:00100000:0.0:1787863024.253601:0:14320:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a6402084000:14320] 1 exiting: rc = 0 00000100:00100000:0.0:1787863024.253697:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253706:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253713:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253719:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253727:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253735:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253741:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253748:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253754:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253761:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253767:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253785:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253794:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253800:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253806:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253816:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253822:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253828:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253845:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253853:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253859:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253864:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253882:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253902:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253911:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253918:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253924:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253930:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253936:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253942:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253948:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253953:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253959:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253965:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253971:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253988:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.253995:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254000:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254006:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254012:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254017:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254023:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254061:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254068:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254074:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254080:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254282:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254306:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254314:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254321:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254327:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254333:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254339:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254344:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254350:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254357:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254362:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254378:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254383:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254414:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254421:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254427:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254433:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.254439:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.265746:0:14321:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a6517ec0c00:14321] 0 exiting: rc = 1 00000100:00100000:2.0:1787863024.266427:0:14322:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a650939fa00:14322] 1 exiting: rc = 0 00000100:00100000:0.0:1787863024.266950:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266959:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266965:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266970:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266978:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266983:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266988:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266994:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.266998:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267003:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267007:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267012:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267017:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267022:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267026:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267185:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267193:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267198:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267203:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267207:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267212:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267216:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267221:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267225:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267230:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267234:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267238:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267243:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267260:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267264:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267268:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267273:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267278:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267282:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267287:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267291:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267296:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267300:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267304:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267309:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267313:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267318:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267323:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267327:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267332:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267336:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267341:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267346:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267350:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267354:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267358:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267363:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267367:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267371:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267375:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267380:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267384:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267399:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267404:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267409:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267413:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267417:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267421:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.267434:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.268378:0:14324:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a6517ec1e00:14324] 1 exiting: rc = 0 00000100:00100000:2.0:1787863024.268855:0:14323:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a6517ec1400:14323] 0 exiting: rc = 1 00000100:00100000:0.0:1787863024.269018:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269025:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269064:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269071:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269078:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269083:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269252:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269259:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269264:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269271:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269276:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269281:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269286:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269291:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269297:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269302:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269308:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269314:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269321:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269326:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269332:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269338:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269343:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269349:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269355:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269361:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269366:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269371:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269376:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269382:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269395:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269401:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269408:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269413:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269434:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269440:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269445:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269450:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269455:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269462:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269467:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269472:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269478:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269483:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269487:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269492:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269496:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269502:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269507:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269512:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269516:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269521:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269526:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269531:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269536:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269541:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269546:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269551:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269556:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269561:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269565:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269569:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269573:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.269580:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270656:0:14326:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a65098e9400:14326] 1 exiting: rc = 0 00000100:00100000:0.0:1787863024.270863:0:14325:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a65098e9600:14325] 0 exiting: rc = 1 00000100:00100000:3.0:1787863024.270956:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270963:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270968:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270973:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270978:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270984:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270989:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.270995:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271001:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271007:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271012:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271017:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271023:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271028:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271063:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271068:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271073:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271078:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271083:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271098:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271103:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271108:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271113:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271118:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271123:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271128:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271133:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271138:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271143:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271147:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271162:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271167:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271172:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271177:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271182:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271188:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271193:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271198:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271202:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271207:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271212:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271217:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271222:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271226:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271231:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271236:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271241:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271246:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271251:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271255:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271260:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271264:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271268:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271273:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271277:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271282:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271286:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271291:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271295:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271300:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271305:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271310:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271315:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271321:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787863024.271973:0:14328:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a6511732a00:14328] 1 exiting: rc = 0 00000100:00100000:0.0:1787863024.272731:0:14327:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a6511732600:14327] 0 exiting: rc = 1 00000100:00100000:2.0:1787863024.273751:0:14329:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a64019a8200:14329] 2 exiting: rc = 0 00000100:00100000:0.0:1787863024.273974:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.273982:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.273988:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274002:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274014:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274024:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274058:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274065:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274073:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274080:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274094:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274100:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274106:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274125:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274132:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274138:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274144:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274150:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274156:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274162:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274168:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274174:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274179:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274184:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274190:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274195:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274201:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274206:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274211:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274217:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274223:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274229:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274235:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274241:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274247:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274252:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274257:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274273:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274284:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274290:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274295:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274301:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274306:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274312:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274318:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274325:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274330:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274335:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274341:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274347:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274352:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274359:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274364:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274370:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274376:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274382:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274397:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274404:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274410:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274415:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274421:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274427:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274432:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863024.274447:0:22351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787863024.283349:0:22351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787863024.283370:0:22351:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787863024.283379:0:22351:0:(genops.c:885:class_export_put()) final put ffff9a65347da800/MDS_uuid 00000020:00000080:0.0:1787863024.283384:0:22351:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65347da800/MDS_uuid for MDS 00000020:01000000:0.0:1787863024.283403:0:22351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787863024.283963:0:22351:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1787863024.797378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787863024.797401:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787863024.797406:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787863024.797414:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 749 00000100:00080000:2.0:1787863024.797420:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787863024.797427:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a653e4b3000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787863024.797449:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787863024.797451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a653d9bcb40 x1874709526516608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787863024.797465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787863024.797468:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1787863024.797468:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526516480:0@lo:400:kworker.0 00000100:00080000:2.0:1787863024.797470:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787863024.797473:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 749 00000100:00080000:2.0:1787863024.797476:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787863024.797491:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6401bc1800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787863024.797501:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a653d9bf480 x1874709526516736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1787863024.797522:0:3283:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874709526516480 offset 0 length 224: 4 00000100:00100000:1.0:1787863024.801555:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526516608:0@lo:38:kworker.0 00000400:00000100:1.0:1787863024.801633:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874709526516608 offset 0 length 520: 4 00000100:00100000:1.0:1787863024.802246:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526516736:0@lo:38:kworker.0 00000400:00000100:1.0:1787863024.802269:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874709526516736 offset 0 length 520: 4 00010000:00010000:0.0:1787863025.057245:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863026.076617:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863027.100322:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863028.124418:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787863028.143635:0:22502:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787863028.160435:0:22502:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787863028.160482:0:22502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.160498:0:22502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.160506:0:22502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.160513:0:22502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.160542:0:22502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787863028.160546:0:22502:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787863028.160569:0:22502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787863028.160579:0:22502:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a653d9bcb40 x1874709526516608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787863039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863028.160600:0:22502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787863028.160607:0:22502:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787863028.160612:0:22502:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787863028.160617:0:22502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787863028.160621:0:22502:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a653d9bcb40 x1874709526516608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787863039 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863028.160628:0:22502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787863028.160631:0:22502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1787863028.160705:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526516608:0@lo:38:kworker.0 00010000:00010000:1.0:1787863028.161028:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863028.161037:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863028.161076:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863028.161080:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863028.161089:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863028.161096:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863028.161103:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787863028.161105:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787863028.161107:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787863028.161146:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863028.161153:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787863028.161184:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863028.161192:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863028.161204:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863028.161218:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863028.161220:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863028.161359:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787863028.161377:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526516864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787863028.161456:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863028.161583:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526516864 00000100:00100000:1.0:1787863028.161592:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526516864 00000100:00100000:1.0:1787863028.161643:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787863028.161651:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1874709526516864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787863028.161658:0:14299:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787863028 with bad export cookie 11264970296908778671 00010000:00010000:0.0:1787863028.163034:0:22502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163163:0:22502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163171:0:22502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163179:0:22502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163201:0:22502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863028.163217:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863028.163222:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163230:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919c00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787863028.163234:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163242:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787863028.163249:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787863028.163255:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787863028.163258:0:14303:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787863028.163289:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163306:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787863028.163323:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163331:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163418:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863028.163421:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863028.163423:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863028.163437:0:22502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163446:0:22502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163452:0:22502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163458:0:22502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863028.163474:0:22502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787863028.163479:0:22502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787863028.163484:0:22502:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787863028.163512:0:22502:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787863028.163518:0:22502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787863028.163524:0:22502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787863028.163530:0:22502:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787863028.163536:0:22502:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff9a6534623800 lustre-MDT0000-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 8589934600 stale:0 00000020:00080000:0.0:1787863028.163549:0:22502:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a6403289a48) has no exports 00000020:00080000:0.0:1787863028.163944:0:22502:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a6403289a48) has no exports 00000100:00100000:3.0:1787863028.164689:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526516992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787863028.164772:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863028.166269:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526516992 00000100:00100000:2.0:1787863028.166283:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526516992 00000100:00100000:2.0:1787863028.166340:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787863028.166350:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3282:x1874709526516992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787863028.166369:0:14301:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787863028 with bad export cookie 11264970296908778671 00000100:00100000:2.0:1787863028.166455:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3282:x1874709526516992:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1682us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787863028.166463:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787863028.166486:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787863028.166497:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863028.166508:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787863028.166513:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863028.166523:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787863028.166531:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787863028.166537:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787863028.166540:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787863028.166562:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787863028.166602:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863028.166609:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787863028.166640:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863028.166648:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863028.166661:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863028.166663:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863028.166664:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863028.166681:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526517120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787863028.166715:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863028.167125:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526517120 00000100:00100000:3.0:1787863028.167130:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526517120 00000100:00100000:3.0:1787863028.167161:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787863028.167166:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1874709526517120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787863028.167171:0:16549:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787863028 with bad export cookie 11264970296908778671 00000100:00100000:3.0:1787863028.167209:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1874709526517120:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (493us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787863028.167215:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787863028.167249:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787863028.167253:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9a651fe84000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787863028.167257:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787863028.170602:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787863028.178385:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1874709526516864:12345-0@lo:103:ldlm_bl.0 Request processed in 16728us (16923us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787863028.178400:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787863028.214350:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.160@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787863028.214367:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787863028.214378:0:3283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a653d9bde00 x1874709526516480/t0(0) o400->MGC192.168.202.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787863040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863028.214394:0:3283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a651682bc00 x1874709526516864/t0(0) o103->MGC192.168.202.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787863044 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863028.214405:0:3283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a651fc630c0 x1874709526516992/t0(0) o103->MGC192.168.202.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787863044 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863028.214413:0:3283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a653d9bcb40 x1874709526517120/t0(0) o103->MGC192.168.202.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787863044 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787863028.214449:0:3282:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a651fe84000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787863028.214692:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526516864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787863028.214727:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526516992:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1787863028.214763:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787863028.214789:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787863028.214790:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787863028.214795:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9a651fe84000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787863028.214800:0:3283:0:(import.c:510:import_select_connection()) MGC192.168.202.160@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1787863028.214809:0:3283:0:(import.c:624:import_select_connection()) MGC192.168.202.160@tcp: import ffff9a651fe84000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863028.214854:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3e940 x1874709526517248/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787863028.214890:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526516480:0@lo:400:kworker.0 00000100:00100000:3.0:1787863028.214908:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526517120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787863028.215304:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3280:1874709526517248:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787863028.215370:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874709526517248 offset 0 length 520: 4 00000001:00100000:0.0:1787863029.029333:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787863029.029356:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a6527319800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787863029.029389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6527319800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787863029.029470:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a652731b000 for lustre-OST0001 00000001:00100000:2.0:1787863029.059537:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787863029.059550:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a6534623800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787863029.059696:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6534623800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787863029.059760:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6534624000 for lustre-OST0000 00010000:00010000:0.0:1787863029.148613:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787863029.916893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5934abbb-415c-4dd1-a04f-dfe9aec97c5f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787863029.916903:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5934abbb-415c-4dd1-a04f-dfe9aec97c5f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787863029.916906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787863029.916909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787863030.172258:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787863030.172853:0:22502:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a653402fae0 - data ffff9a653e857510/ffff9a6402a55400 00000020:01000000:2.0:1787863030.172971:0:22502:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a6509590f00 - data ffff9a650f089d80/ffff9a6402012800 00100000:10000000:2.0:1787863030.183731:0:22502:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787863030.230726:0:22502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930df1 00000020:00000080:3.0:1787863030.230736:0:22502:0:(genops.c:885:class_export_put()) final put ffff9a6526c78800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787863030.230753:0:22502:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650610b000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787863030.230756:0:22502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650610b000 2 00000020:01000004:3.0:1787863030.230759:0:22502:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a650610b000 from lustre-OST0000 00000020:00000080:3.0:1787863030.230783:0:22502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787863030.230793:0:22502:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787863030.230797:0:22502:0:(genops.c:885:class_export_put()) final put ffff9a6509aaa800/lustre-OST0000_UUID 00000020:00000080:3.0:1787863030.230799:0:22502:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6509aaa800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787863030.230805:0:22502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787863030.230859:0:22502:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787863030.230863:0:22502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787863030.230867:0:22502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787863030.230871:0:22502:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787863030.230877:0:22502:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a650741a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787863030.230882:0:22502:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a6403270000) has exports, disconnecting them 00000020:00080000:3.0:1787863030.230887:0:22502:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a650741a800), last request at 1787862729 00000020:00000080:3.0:1787863030.230891:0:22502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930e1b 00000020:00080000:3.0:1787863030.230902:0:22502:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a650741a800): rc 0 00000020:00000080:3.0:1787863030.230918:0:22502:0:(genops.c:885:class_export_put()) final put ffff9a650741a800/lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787863030.231579:0:22502:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787863030.231584:0:22502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787863030.231587:0:22502:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787863030.231592:0:22502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787863030.231733:0:22502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787863030.231738:0:22502:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787863030.231742:0:22502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650610b000 1 00000020:00000080:3.0:1787863030.231745:0:22502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930dc0 00000020:00000080:3.0:1787863030.231750:0:22502:0:(genops.c:885:class_export_put()) final put ffff9a651c1b4800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787863030.231754:0:22502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787863030.231758:0:22502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787863030.231760:0:22502:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787863030.231763:0:22502:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a651c9d1a48) has no exports 00000020:00000080:0.0:1787863030.231877:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6526c78800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787863030.231889:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650741a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787863030.231893:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a653e4b3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787863030.231899:0:8:0:(genops.c:885:class_export_put()) final put ffff9a6507418800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787863030.231901:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6507418800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787863030.231904:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787863030.231940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c1b4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787863030.289112:0:22502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787863030.289126:0:22502:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787863030.289132:0:22502:0:(genops.c:885:class_export_put()) final put ffff9a65091a4000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787863030.289137:0:22502:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65091a4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787863030.289144:0:22502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787863030.289316:0:22502:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6506109800 00000020:02000400:1.0:1787863030.289405:0:22502:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787863031.196333:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863032.221148:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787863032.926424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5934abbb-415c-4dd1-a04f-dfe9aec97c5f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787863032.926437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5934abbb-415c-4dd1-a04f-dfe9aec97c5f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787863032.926442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787863032.926445:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787863033.245838:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787863034.097430:0:22653:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787863034.106250:0:22653:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787863034.106353:0:22653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.106368:0:22653:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.106375:0:22653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.106383:0:22653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.106410:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787863034.106415:0:22653:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787863034.106440:0:22653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787863034.106455:0:22653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a653d9bf480 x1874709526516736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787863039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863034.106470:0:22653:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787863034.106477:0:22653:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787863034.106485:0:22653:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787863034.106490:0:22653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787863034.106494:0:22653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a653d9bf480 x1874709526516736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787863039 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863034.106501:0:22653:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787863034.106519:0:22653:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:3.0:1787863034.107672:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787863034.107688:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863034.107703:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787863034.107707:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863034.107719:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863034.107728:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863034.107734:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787863034.107750:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787863034.107753:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787863034.107770:0:14302:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651fe84000 00010000:00010000:3.0:1787863034.107774:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863034.107782:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863034.107798:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863034.107800:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863034.107802:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863034.115379:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526516736:0@lo:38:kworker.0 00010000:00010000:2.0:1787863034.116658:0:22653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116676:0:22653:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116683:0:22653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116689:0:22653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116713:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787863034.116720:0:22653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116728:0:22653:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116735:0:22653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116741:0:22653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863034.116763:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787863034.116768:0:22653:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787863034.116796:0:22653:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787863034.116801:0:22653:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787863034.116805:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863034.116827:0:22653:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787863034.116832:0:22653:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a6403288000) has no exports 00000020:00080000:2.0:1787863034.117104:0:22653:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a6403288000) has no exports 00010000:00010000:1.0:1787863034.117677:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787863034.117687:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117713:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863034.117718:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117729:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863034.117737:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863034.117743:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787863034.117745:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787863034.117748:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787863034.117766:0:14302:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651fe84000 00010000:00010000:1.0:1787863034.117770:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117777:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117791:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863034.117794:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117801:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863034.117804:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117810:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863034.117823:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863034.117829:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787863034.117831:0:14302:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787863034.117833:0:14302:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787863034.117838:0:14302:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651fe84000 00010000:00010000:1.0:1787863034.117841:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117847:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863034.117859:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863034.117860:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863034.117862:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863034.120106:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787863034.123550:0:22653:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a653402f240 - data ffff9a65022f15e8/ffff9a6402a56c00 00000020:01000000:2.0:1787863034.123807:0:22653:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a65108eb060 - data ffff9a6539feed80/ffff9a640186f800 00100000:10000000:2.0:1787863034.134847:0:22653:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787863034.261078:0:22653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930f25 00000020:00000080:3.0:1787863034.261095:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a653441e800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787863034.261114:0:22653:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650741b800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787863034.261118:0:22653:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650741b800 2 00000020:01000004:3.0:1787863034.261122:0:22653:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a650741b800 from lustre-OST0001 00000020:00000080:3.0:1787863034.261149:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787863034.261161:0:22653:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787863034.261164:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a6526c79800/lustre-OST0001_UUID 00000020:00000080:3.0:1787863034.261167:0:22653:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6526c79800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787863034.261175:0:22653:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787863034.261333:0:22653:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5934abbb-415c-4dd1-a04f-dfe9aec97c5f->MGS 00010000:00010000:3.0:1787863034.261353:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863034.261367:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863034.261375:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787863034.261377:0:22653:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787863034.261395:0:22653:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787863034.261418:0:22653:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651fe84000 00010000:00010000:3.0:1787863034.261422:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863034.261437:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787863034.261443:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863034.261448:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787863034.261450:0:22653:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787863034.261452:0:22653:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787863034.261461:0:22653:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651fe84000 00010000:00010000:3.0:1787863034.261464:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787863034.261482:0:22653:0:(import.c:65:import_set_state_nolock()) ffff9a651fe84000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787863034.261487:0:22653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787863034.261490:0:22653:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787863034.261491:0:22653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787863034.261496:0:22653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787863034.261507:0:22653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6401b3e940 x1874709526517248/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787863038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787863034.261534:0:22653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787863034.261537:0:22653:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000020:00000080:0.0:1787863034.261623:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a653441e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787863034.261752:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3280:1874709526517248:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787863034.264235:0:22653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787863034.264265:0:22653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930ca1 00000020:00000080:3.0:1787863034.264279:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a65347d8000/5934abbb-415c-4dd1-a04f-dfe9aec97c5f 00000020:01000000:3.0:1787863034.264319:0:22653:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.160@tcp (flags='') 00000020:00000080:3.0:1787863034.264331:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787863034.264355:0:22653:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787863034.264361:0:22653:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a6533eeb490) has no exports 00000020:00000080:0.0:1787863034.264435:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65347d8000/5934abbb-415c-4dd1-a04f-dfe9aec97c5f for MGC192.168.202.160@tcp 10000000:01000000:2.0:1787863034.264593:0:14311:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787863034.266498:0:22653:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.160@tcp: client import never connected 00000100:00080000:3.0:1787863034.266508:0:22653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787863034.266513:0:22653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787863034.266517:0:22653:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787863034.266520:0:22653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787863034.266592:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787863034.266602:0:22653:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.160@tcp (uuid 5934abbb-415c-4dd1-a04f-dfe9aec97c5f) 00000020:01000000:3.0:1787863034.266613:0:22653:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787863034.266620:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787863034.266625:0:22653:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787863034.266634:0:22653:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a6401bc0000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787863034.266642:0:22653:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9a640328ced8) has exports, disconnecting them 00000020:00080000:3.0:1787863034.266647:0:22653:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a6401bc0000), last request at 1787862752 00000020:00000080:3.0:1787863034.266652:0:22653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930f4f 00000020:00080000:3.0:1787863034.266672:0:22653:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6401bc0000): rc 0 00000020:00000080:3.0:1787863034.266677:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a6401bc0000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787863034.267545:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651fe84000 for MGC192.168.202.160@tcp 00000020:00000080:2.0:1787863034.267558:0:36:0:(genops.c:885:class_export_put()) final put ffff9a651fe82000/5934abbb-415c-4dd1-a04f-dfe9aec97c5f 00000020:00000080:2.0:1787863034.267562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651fe82000/5934abbb-415c-4dd1-a04f-dfe9aec97c5f for MGC192.168.202.160@tcp 00000020:01000000:2.0:1787863034.267581:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.160@tcp (5934abbb-415c-4dd1-a04f-dfe9aec97c5f) 00000020:00000080:2.0:1787863034.267864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6401bc0000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787863034.271318:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1787863034.292787:0:22653:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787863034.292798:0:22653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787863034.292803:0:22653:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787863034.292811:0:22653:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787863034.292873:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787863034.292992:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1787863034.293432:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6401bc1800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1787863034.293858:0:14298:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a6510a50a00:14298] 1 exiting: rc = 0 00000100:00100000:3.0:1787863034.293928:0:14297:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a6533ee6800:14297] 0 exiting: rc = 1 00000100:00100000:0.0:1787863034.294064:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.295160:0:14300:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a6403027600:14300] 1 exiting: rc = 0 00000100:00100000:2.0:1787863034.295254:0:16549:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a652723ac00:16549] 3 exiting: rc = 0 00000100:00100000:0.0:1787863034.296153:0:14299:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a6403027400:14299] 0 exiting: rc = 1 00000100:00100000:2.0:1787863034.300210:0:14301:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a653d9f3a00:14301] 2 exiting: rc = 0 00000100:00100000:0.0:1787863034.300517:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300530:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300538:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300544:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300550:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300556:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300562:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300569:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300575:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300584:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300589:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300594:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300600:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300605:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300610:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300615:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300621:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300626:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300632:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300637:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300641:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300647:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300652:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300656:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300662:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300669:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300674:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300679:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300684:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300690:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300695:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300701:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300706:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300731:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300738:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300745:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300750:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300755:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300761:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300767:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300772:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300777:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300783:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300788:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300793:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300799:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300805:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300811:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300817:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300822:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300829:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300834:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300840:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300846:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300852:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300857:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300862:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300868:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300874:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300879:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300885:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300891:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300896:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.300902:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787863034.305870:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787863034.305890:0:22653:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787863034.305898:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a653441a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787863034.305903:0:22653:0:(genops.c:844:class_export_destroy()) destroying export ffff9a653441a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787863034.305928:0:22653:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787863034.306020:0:22653:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650741b800 1 00000020:00000080:0.0:1787863034.306027:0:22653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930f09 00000020:00000080:0.0:1787863034.306035:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a652731a000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787863034.306085:0:22653:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787863034.306092:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787863034.306097:0:22653:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787863034.306103:0:22653:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a6403274ed8) has no exports 00000020:00000080:2.0:1787863034.306265:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a652731a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787863034.325775:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863034.325792:0:22653:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787863034.325798:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a650741c000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787863034.325803:0:22653:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650741c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787863034.325819:0:22653:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787863034.326063:0:22653:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a650741a000 00000020:01000000:2.0:1787863034.326092:0:22653:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787863034.326096:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787863034.326101:0:22653:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787863034.326106:0:22653:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a65401c9a48) has no exports 00000020:00000080:2.0:1787863034.326152:0:22653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787863034.326159:0:22653:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787863034.326162:0:22653:0:(genops.c:885:class_export_put()) final put ffff9a651c1b7800/OSS_uuid 00000020:00000080:2.0:1787863034.326165:0:22653:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c1b7800/OSS_uuid for OSS 00000020:01000000:2.0:1787863034.326169:0:22653:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787863034.326239:0:15001:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a6509eb6000:15001] 2 exiting: rc = 0 00000100:00080000:0.0:1787863034.328975:0:14310:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787863034.333807:0:16604:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a6540df9600:16604] 3 exiting: rc = 0 00000100:00100000:0.0:1787863034.333903:0:15000:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a6509eb6c00:15000] 1 exiting: rc = 0 00000100:00100000:0.0:1787863034.333982:0:14998:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a6509eb7a00:14998] 0 exiting: rc = 1 00000100:00100000:2.0:1787863034.334157:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334170:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334179:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334187:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334192:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334199:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334206:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334215:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334221:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334229:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334235:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334240:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334247:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334252:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334258:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334264:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334270:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334275:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334282:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334290:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334307:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334314:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334320:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334326:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334331:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334337:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334342:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334351:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334357:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334385:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334391:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334397:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334403:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334408:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334415:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334420:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334427:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334432:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334439:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334445:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334461:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334468:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334473:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334478:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334484:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334490:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334495:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334501:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334507:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334513:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334518:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334524:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334531:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334537:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334543:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334549:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334554:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334562:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334568:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334574:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334580:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334586:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334592:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.334598:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787863034.336835:0:15003:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a6512518c00:15003] 1 exiting: rc = 0 00000100:00100000:0.0:1787863034.337026:0:16197:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a653d218600:16197] 2 exiting: rc = 0 00000100:00100000:0.0:1787863034.337123:0:15002:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a6512519a00:15002] 0 exiting: rc = 1 00000100:00100000:2.0:1787863034.337553:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337564:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337571:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337577:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337583:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337589:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337595:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337601:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337607:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337613:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337619:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337624:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337634:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337640:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337646:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337653:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337658:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337664:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337671:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337677:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337683:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337688:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337695:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337701:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337706:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337711:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337716:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337721:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337729:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337734:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337740:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337745:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337750:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337755:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337760:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337782:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337787:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337792:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337797:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337803:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337809:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337814:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337821:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337829:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337835:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337841:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337846:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337851:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337857:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337862:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337868:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337875:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337880:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337886:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337892:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337897:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337903:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337908:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337914:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337919:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337925:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337930:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337935:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.337940:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.339696:0:15004:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a6512519000:15004] 0 exiting: rc = 1 00000100:00100000:0.0:1787863034.339969:0:15006:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a6512519e00:15006] 2 exiting: rc = 0 00000100:00100000:0.0:1787863034.340305:0:15005:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a6512518400:15005] 1 exiting: rc = 0 00000100:00100000:2.0:1787863034.340753:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340761:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340768:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340775:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340782:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340788:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340810:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340817:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340824:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340843:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340850:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340856:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340863:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340870:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340877:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340884:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340890:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340897:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340904:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340911:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.340918:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341337:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341346:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341352:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341358:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341364:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341370:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341376:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341381:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341388:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341396:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341402:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341412:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341437:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341445:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341452:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341458:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341463:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341469:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341475:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341481:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341498:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341503:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341509:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341515:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341521:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341526:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341532:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341538:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341555:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341570:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341577:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341591:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341598:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341605:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341611:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341619:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341626:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341632:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341638:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341644:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341651:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341657:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.341663:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.353597:0:15007:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a6512519400:15007] 0 exiting: rc = 1 00000100:00100000:2.0:1787863034.353836:0:15008:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a6502e9e800:15008] 1 exiting: rc = 0 00000100:00100000:2.0:1787863034.353905:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353912:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353918:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353938:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353944:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353950:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353955:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353960:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353965:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353970:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.353975:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354004:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354015:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354024:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354029:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354035:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354559:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354572:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354578:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354584:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354590:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354596:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354634:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354640:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354646:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354651:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354656:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354662:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354667:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354673:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354679:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354685:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354689:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354696:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354703:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354710:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354717:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354723:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354729:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354735:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354740:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354746:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354760:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354767:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354774:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354779:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354792:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354799:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354805:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354812:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354818:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354824:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354833:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354844:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354850:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354856:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354861:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354867:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354872:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354878:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354883:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354888:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354893:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.354898:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787863034.356496:0:15009:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a6526cbc600:15009] 0 exiting: rc = 1 00000100:00100000:2.0:1787863034.366646:0:15010:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a6526cbd600:15010] 1 exiting: rc = 0 00000100:00100000:2.0:1787863034.366844:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366856:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366863:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366870:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366877:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366886:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366892:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366901:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366908:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.366913:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368245:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368269:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368317:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368325:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368332:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368340:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368359:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368365:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368372:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368379:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368387:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368393:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368400:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368407:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368428:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368435:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368445:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368452:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368457:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368463:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368471:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368479:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368489:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368494:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368506:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368514:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368537:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368546:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368551:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368558:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368565:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368570:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368575:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368581:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368588:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368594:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368599:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368604:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368624:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368631:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368639:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368653:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368659:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368665:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368671:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368678:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368684:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368691:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368699:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368706:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368732:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368740:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368748:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787863034.368755:0:22653:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787863034.397741:0:22653:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787863053.586944:0:23267:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787863065.919687:0:23734:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787863065.919693:0:23734:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787863065.919799:0:23734:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a6527360000 00000020:01000004:2.0:1787863065.919815:0:23734:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787863065.919823:0:23734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787863065.919839:0:23734:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a6403274ed8) 00000020:00000080:2.0:1787863065.919853:0:23734:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787863065.942140:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787863065.944881:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1787863065.945498:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787863065.945818:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787863065.945892:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787863065.946097:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787863065.946188:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787863065.946282:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787863065.946372:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787863065.946622:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1787863065.948455:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 274: rc = 0 00100000:10000000:3.0:1787863065.948568:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 274: rc = 0 00100000:10000000:3.0:1787863065.949340:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 642: rc = 0 00100000:10000000:3.0:1787863065.949990:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787863065.950360:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787863065.950599:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 642: rc = 0 00100000:10000000:3.0:1787863065.952388:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787863065.952842:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 642: rc = 0 00100000:10000000:3.0:1787863065.953349:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787863065.953599:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1787863065.954230:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1787863065.954816:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787863065.955529:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787863065.956036:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1787863065.956765:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:3.0:1787863065.957980:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:3.0:1787863065.958390:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:3.0:1787863065.959494:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:3.0:1787863065.960177:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:3.0:1787863065.960455:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:3.0:1787863065.960843:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:3.0:1787863065.961394:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:3.0:1787863065.961636:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:3.0:1787863065.962338:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:3.0:1787863065.962597:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:3.0:1787863065.963281:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:3.0:1787863065.963543:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:3.0:1787863065.964573:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:3.0:1787863065.965226:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:3.0:1787863065.965483:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:3.0:1787863065.966030:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:3.0:1787863065.966389:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:3.0:1787863065.966639:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:3.0:1787863065.967565:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:3.0:1787863065.968959:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:3.0:1787863065.969297:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:3.0:1787863065.969544:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:3.0:1787863065.969802:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:3.0:1787863065.970090:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:3.0:1787863065.970348:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:3.0:1787863065.970600:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:3.0:1787863065.970834:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:3.0:1787863065.971129:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:3.0:1787863065.971387:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:3.0:1787863065.971644:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:3.0:1787863065.971879:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:3.0:1787863065.973515:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 596: rc = 0 00100000:10000000:1.0:1787863065.986447:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787863065.986623:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 275: rc = 0 00100000:10000000:1.0:1787863065.987341:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787863065.987414:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 275: rc = 0 00100000:10000000:1.0:1787863065.987614:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787863065.989582:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 275: rc = 0 00100000:10000000:1.0:1787863065.991531:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787863065.991620:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:1.0:1787863065.994946:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787863065.995086:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:1.0:1787863065.996777:0:23734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787863065.996949:0:23734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00000020:00000080:1.0:1787863065.997283:0:23734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787863065.997292:0:23734:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787863065.997303:0:23734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf89316c6 00000020:01000004:1.0:1787863065.997312:0:23734:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787863065.997317:0:23734:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787863065.997322:0:23734:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6527360000 from MGS 00000020:01000004:1.0:1787863065.997325:0:23734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787863065.997336:0:23734:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a6526ce1a48) 00000020:00000080:1.0:1787863065.997346:0:23734:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787863065.997400:0:23734:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6527360000 from MGS, refs=2 00080000:01000000:1.0:1787863065.997404:0:23734:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787863065.997408:0:23734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf89316d4 00000100:00100000:1.0:1787863065.997501:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787863065.997636:0:23734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787863065.997641:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787863066.002014:0:23734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787863066.002033:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787863066.002883:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787863066.003448:0:23734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787863066.003456:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787863066.005344:0:23734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787863066.005358:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787863066.006216:0:23734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787863066.006224:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787863066.006896:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863066.006899:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863066.006902:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863066.007247:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863066.007250:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863066.007252:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863066.007653:0:23734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787863066.013164:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787863066.018640:0:23734:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787863066.018745:0:23734:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787863066.018748:0:23734:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787863066.029313:0:23743:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787863066.035095:0:23734:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787863066.035217:0:23734:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787863066.035772:0:23734:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787863066.036189:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787863066.037303:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787863066.037312:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787863066.039834:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787863066.039854:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787863066.040775:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787863066.040786:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787863066.047135:0:23734:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787863066.047166:0:23734:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.160@tcp' 00000020:01000004:3.0:1787863066.047168:0:23734:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787863066.047199:0:23734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.160@tcp (typ=mgc) 00000020:00000080:3.0:1787863066.047214:0:23734:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.160@tcp (ffff9a6403288000) 00000020:00000080:3.0:1787863066.047231:0:23734:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787863066.047319:0:23734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a653d3c3800@MGC192.168.202.160@tcp: add connection 192.168.202.160@tcp at head 00010000:00010000:3.0:1787863066.047508:0:23734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.160@tcp-0 is initialized 00000040:01000000:3.0:1787863066.047515:0:23734:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787863066.049253:0:23748:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787863066.052564:0:23749:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787863066.052626:0:23734:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.160@tcp (uuid 38779eb7-76b5-435e-9dc5-da8e02f86cb2) 00000020:00000080:2.0:1787863066.052673:0:23734:0:(genops.c:1385:class_connect()) connect: client 38779eb7-76b5-435e-9dc5-da8e02f86cb2, cookie 0x9c5536ccf89316e2 00000100:00080000:2.0:1787863066.052686:0:23734:0:(import.c:510:import_select_connection()) MGC192.168.202.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787863066.052693:0:23734:0:(import.c:624:import_select_connection()) MGC192.168.202.160@tcp: import ffff9a653d3c3800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787863066.052731:0:23734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a653d9bc3c0 x1874709526517376/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787863066.052756:0:23734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 38779eb7-76b5-435e-9dc5-da8e02f86cb2->MGS 00000020:01000004:2.0:1787863066.052776:0:23734:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787863066.052780:0:23734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787863066.052793:0:23734:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a6403273490) 00000020:00000080:2.0:1787863066.052806:0:23734:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787863066.055217:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3280:1874709526517376:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787863066.055318:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863066.055462:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526517376 00000100:00100000:2.0:1787863066.055472:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526517376 00000100:00100000:2.0:1787863066.055512:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787863066.055520:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65407a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3280:x1874709526517376:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787863066.055553:0:23745:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 38779eb7-76b5-435e-9dc5-da8e02f86cb2@0@lo t0 exp 0000000000000000 cur 791 last 0 00000020:00000080:2.0:1787863066.055587:0:23745:0:(genops.c:1385:class_connect()) connect: client 38779eb7-76b5-435e-9dc5-da8e02f86cb2, cookie 0x9c5536ccf89316f0 00000100:00080000:2.0:1787863066.055773:0:23745:0:(import.c:65:import_set_state_nolock()) ffff9a6403292000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863066.055839:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65407a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+5:3280:x1874709526517376:12345-0@lo:250:mount.lustre.0 Request processed in 318us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.055847:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787863066.055898:0:3280:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787863066.055907:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1787863066.055916:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787863066.055921:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787863066.055925:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653d3c3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787863066.055934:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787863066.055938:0:3280:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787863066.055944:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3280:1874709526517376:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787863066.083396:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787863066.083613:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787863066.083620:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787863066.093914:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787863066.093930:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787863066.095086:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787863066.095095:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787863066.095803:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787863066.095993:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787863066.095997:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787863066.098078:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787863066.098091:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787863066.176339:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787863066.176582:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787863066.176592:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787863066.177752:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787863066.177764:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787863066.178552:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787863066.178733:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787863066.178739:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787863066.179241:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787863066.179248:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787863066.179701:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787863066.180370:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787863066.180397:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787863066.180808:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787863066.180816:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787863066.181421:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787863066.181580:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787863066.181584:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787863066.182399:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787863066.182407:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787863066.197308:0:23734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787863066.197552:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787863066.197559:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787863066.199450:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787863066.199464:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787863066.203493:0:23734:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787863066.203510:0:23734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787863066.205813:0:23734:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787863066.205840:0:23734:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787863066.205848:0:23734:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787863066.206197:0:23734:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787863066.206246:0:23734:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787863066.206252:0:23734:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787863066.206254:0:23734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787863066.206256:0:23734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863066.206257:0:23734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863066.206258:0:23734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863066.208064:0:23734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863066.208067:0:23734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787863066.208069:0:23734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787863066.208071:0:23734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863066.208072:0:23734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787863066.208077:0:23734:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787863066.208082:0:23734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787863066.208084:0:23734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787863066.208085:0:23734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863066.208086:0:23734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863066.208087:0:23734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863066.208106:0:23734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863066.208107:0:23734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787863066.208109:0:23734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787863066.208110:0:23734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863066.208111:0:23734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787863066.208145:0:23734:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787863066.208166:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787863066.208248:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863066.208310:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787863066.208425:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526517504 00000100:00100000:1.0:1787863066.208434:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526517504 00000100:00100000:1.0:1787863066.208487:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863066.208498:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65407a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+5:23734:x1874709526517504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787863066.208550:0:23747:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787863066.208553:0:23747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787863066.208556:0:23747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787863066.209378:0:23768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787863066.209976:0:23747:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:2.0:1787863066.211844:0:23769:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787863066.211854:0:23769:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787863066.211857:0:23769:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787863066.211965:0:23769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787863066.212577:0:23747:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787863066.212593:0:23747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787863066.219476:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65407a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+5:23734:x1874709526517504:12345-0@lo:253:mount.lustre.0 Request processed in 10969us (11216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863066.219494:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787863066.219613:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787863066.219629:0:23734:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787863066.219632:0:23734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787863066.219634:0:23734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787863066.219635:0:23734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787863066.219636:0:23734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787863066.219662:0:23734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787863066.219664:0:23734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787863066.219665:0:23734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787863066.219667:0:23734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787863066.219668:0:23734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787863066.219670:0:23734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787863066.219694:0:23734:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6527360000 from lustre-MDT0000 10000000:01000000:3.0:1787863066.219731:0:23734:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787863066.219734:0:23734:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787863066.219739:0:23734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a6403288000 10000000:01000000:3.0:1787863066.219743:0:23734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787863066.219751:0:23734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6403288000 from 1 10000000:01000000:3.0:1787863066.219754:0:23734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787863066.219798:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.219809:0:23734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.219818:0:23734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863066.219838:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787863066.220086:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.220126:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785900 going to sleep for 11 seconds 00000100:00100000:1.0:1787863066.220192:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526517632 00000100:00100000:1.0:1787863066.220198:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526517632 00000100:00100000:1.0:1787863066.220244:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787863066.220255:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+5:23734:x1874709526517632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863066.220269:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863066.220283:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b79a00/0x9c5536ccf89316fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89316f7 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.220308:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b79a00/0x9c5536ccf89316fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89316f7 expref: 6 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.220332:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b79a00/0x9c5536ccf89316fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89316f7 expref: 6 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.220342:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79a00, rc 0) 00000100:00100000:1.0:1787863066.220382:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+6:23734:x1874709526517632:12345-0@lo:101:mount.lustre.0 Request processed in 129us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863066.220390:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787863066.220510:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787863066.220525:0:23734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.220534:0:23734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863066.220582:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787863066.220606:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863066.220749:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509956b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787863066.220794:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526517760 00000100:00100000:1.0:1787863066.220798:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526517760 00000100:00100000:1.0:1787863066.220855:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787863066.220869:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+6:23734:x1874709526517760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863066.221123:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+6:23734:x1874709526517760:12345-0@lo:501:mount.lustre.0 Request processed in 262us (516us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787863066.221131:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787863066.221192:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517760:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787863066.221218:0:23734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787863066.221229:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.221238:0:23734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863066.221256:0:23734:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6527360000 10000000:01000000:3.0:1787863066.221260:0:23734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787863066.221264:0:23734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a6527360000 10000000:01000000:3.0:1787863066.221267:0:23734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787863066.221270:0:23734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a6527360000 from 1 10000000:01000000:3.0:1787863066.221272:0:23734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787863066.221290:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.221297:0:23734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.221305:0:23734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863066.221318:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787863066.221344:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.221614:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785840 going to sleep for 11 seconds 00000100:00100000:0.0:1787863066.221813:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526517888 00000100:00100000:0.0:1787863066.221818:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526517888 00000100:00100000:0.0:1787863066.221842:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787863066.221848:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+6:23734:x1874709526517888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787863066.221866:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863066.221880:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637200/0x9c5536ccf893170c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931705 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.221897:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637200/0x9c5536ccf893170c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931705 expref: 7 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.221907:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637200/0x9c5536ccf893170c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931705 expref: 7 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.221914:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637200, rc 0) 00000100:00100000:0.0:1787863066.221954:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+7:23734:x1874709526517888:12345-0@lo:101:mount.lustre.0 Request processed in 106us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863066.221960:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787863066.222085:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526517888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787863066.222097:0:23734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893170c expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.222105:0:23734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf893170c expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863066.222118:0:23734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787863066.222133:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893170c expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.222150:0:23734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf8931705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893170c expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863066.222156:0:23734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787863066.222159:0:23734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787863066.222163:0:23734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a6527360000 10000000:01000000:3.0:1787863066.222166:0:23734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787863066.222168:0:23734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787863066.222171:0:23734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787863066.222185:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.222192:0:23734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.222199:0:23734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863066.222211:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526518016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787863066.222235:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.222250:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785840 going to sleep for 11 seconds 00000100:00100000:0.0:1787863066.222305:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526518016 00000100:00100000:0.0:1787863066.222309:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526518016 00000100:00100000:0.0:1787863066.222327:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863066.222332:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+7:23734:x1874709526518016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787863066.222339:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863066.222347:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637e00/0x9c5536ccf893171a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931713 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.222360:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637e00/0x9c5536ccf893171a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931713 expref: 8 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.222379:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637e00/0x9c5536ccf893171a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931713 expref: 8 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.222385:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637e00, rc 0) 00000100:00100000:0.0:1787863066.222417:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+8:23734:x1874709526518016:12345-0@lo:101:mount.lustre.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863066.222423:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787863066.222487:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526518016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787863066.222496:0:23734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893171a expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.222504:0:23734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf893171a expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863066.222554:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526518144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863066.222576:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.222593:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785840 going to sleep for 11 seconds 00000100:00100000:0.0:1787863066.222637:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526518144 00000100:00100000:0.0:1787863066.222649:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526518144 00000100:00100000:0.0:1787863066.222664:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787863066.222669:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+8:23734:x1874709526518144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787863066.223228:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23734:x1874709526518144:12345-0@lo:501:mount.lustre.0 Request processed in 558us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863066.223235:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787863066.223315:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526518144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863066.223343:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526518272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863066.223380:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.223407:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785840 going to sleep for 11 seconds 00000100:00100000:0.0:1787863066.223455:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526518272 00000100:00100000:0.0:1787863066.223460:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526518272 00000100:00100000:0.0:1787863066.223476:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787863066.223481:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23734:x1874709526518272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787863066.223950:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23734:x1874709526518272:12345-0@lo:503:mount.lustre.0 Request processed in 466us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863066.223957:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787863066.224220:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526518272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863066.225329:0:23770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23770:1874709526518400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787863066.225391:0:23770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.225473:0:23770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65347859c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.225973:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526518400 00000100:00100000:2.0:1787863066.225982:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526518400 00000100:00100000:0.0:1787863066.226068:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787863066.226141:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23770:x1874709526518400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787863066.226571:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23770:x1874709526518400:12345-0@lo:502:llog_process_th.0 Request processed in 494us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863066.226584:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787863066.226978:0:23770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23770:1874709526518400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787863066.227027:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863066.227444:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.227450:0:23770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787863066.227460:0:23770:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787863066.227464:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787863066.227483:0:23770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a6526ce4ed8) 00000020:00000080:1.0:1787863066.227510:0:23770:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787863066.227516:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787863066.227605:0:23770:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787863066.227613:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8931728 00000020:00000080:1.0:1787863066.228154:0:23770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787863066.228160:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863066.228164:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.228166:0:23770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787863066.228169:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863066.228184:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.228186:0:23770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787863066.228191:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787863066.228200:0:23770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a6526ce3490) 00000020:00000080:1.0:1787863066.228210:0:23770:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787863066.228214:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787863066.228216:0:23770:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787863066.228218:0:23770:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787863066.228225:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787863066.228270:0:23770:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6527360000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787863066.228283:0:23770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a6526ce0000) 00000020:00000080:1.0:1787863066.228290:0:23770:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787863066.228355:0:23770:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787863066.228366:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf893173d 00000020:00000080:1.0:1787863066.228464:0:23770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787863066.228471:0:23770:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787863066.228475:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c5536ccf8931744 00080000:01000000:1.0:1787863066.228481:0:23770:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787863066.228484:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf893174b 00010000:00010000:2.0:1787863066.354075:0:23770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787863066.354887:0:23770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934675 00000001:00080000:2.0:1787863066.355140:0:23770:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787863066.356368:0:23770:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a6403271a48) 00000020:00000080:2.0:1787863066.356393:0:23770:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787863066.356495:0:23770:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787863066.356506:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8931759 00000020:00000080:2.0:1787863066.360245:0:23770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787863066.370185:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c5536ccf8931760 00000020:00000080:3.0:1787863066.370587:0:23770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787863066.370608:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863066.370618:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.370619:0:23770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787863066.370622:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787863066.370625:0:23770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787863066.370627:0:23770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787863066.370628:0:23770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787863066.370629:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787863066.370631:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.370638:0:23770:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787863066.370642:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863066.370647:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.370649:0:23770:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787863066.370654:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787863066.370711:0:23770:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787863066.370737:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863066.370740:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.370741:0:23770:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787863066.370744:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787863066.370747:0:23770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787863066.370750:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.370751:0:23770:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787863066.370754:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787863066.370759:0:23770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:3.0:1787863066.370786:0:23770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787863066.370789:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787863066.370803:0:23770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a6403289a48) 00000020:00000080:3.0:1787863066.370817:0:23770:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787863066.370822:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787863066.370874:0:23770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787863066.370880:0:23770:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787863066.370888:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf893176e 00010000:00080000:3.0:1787863066.370927:0:23770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6509a24000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:3.0:1787863066.371250:0:23770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787863066.371612:0:23770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787863066.371659:0:23770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787863066.372619:0:23770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787863066.372692:0:23770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787863066.372766:0:23770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787863066.373971:0:23774:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787863066.373978:0:23774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787863066.375643:0:23770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787863066.375659:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787863066.375775:0:23770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787863066.375796:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf8931775 00000100:00080000:1.0:1787863066.375808:0:23770:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787863066.375815:0:23770:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6509a24000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787863066.375854:0:23770:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6516828f00 x1874709526518528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787863066.375926:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526518528:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787863066.375989:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526518528 offset 0 length 520: 4 00000100:00080000:1.0:1787863066.376170:0:23770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787863066.376309:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526518656:0@lo:400:kworker.0 00000100:00100000:3.0:1787863066.376349:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.376402:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526518656 00000100:00100000:3.0:1787863066.376410:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526518656 00000100:00100000:3.0:1787863066.376452:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787863066.376460:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:3284:x1874709526518656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863066.376508:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:3284:x1874709526518656:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863066.376515:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787863066.376564:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526518656:0@lo:400:kworker.0 00000020:01000000:1.0:1787863066.376789:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863066.376794:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.376796:0:23770:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787863066.376799:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787863066.376815:0:23770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787863066.376817:0:23770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787863066.376819:0:23770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787863066.376821:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787863066.376824:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.376825:0:23770:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787863066.376828:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787863066.376833:0:23770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787863066.376836:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.376838:0:23770:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787863066.376840:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787863066.376844:0:23770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:1.0:1787863066.376869:0:23770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787863066.376871:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787863066.376887:0:23770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a653aa2b490) 00000020:00000080:1.0:1787863066.376902:0:23770:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787863066.376907:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787863066.376974:0:23770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787863066.376981:0:23770:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787863066.376989:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8931783 00010000:00080000:1.0:1787863066.377031:0:23770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6527d3a000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1787863066.377353:0:23770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787863066.377560:0:23770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787863066.377585:0:23770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787863066.378449:0:23770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787863066.380371:0:23770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787863066.380496:0:23770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1787863066.383440:0:23776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787863066.383448:0:23776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787863066.386399:0:23770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787863066.386424:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787863066.386474:0:23770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787863066.386500:0:23770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf893178a 00000100:00080000:3.0:1787863066.386513:0:23770:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787863066.386520:0:23770:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6527d3a000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863066.386562:0:23770:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3da40 x1874709526518784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787863066.386590:0:23770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787863066.386665:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863066.386669:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.386671:0:23770:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787863066.386674:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863066.386678:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.386679:0:23770:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787863066.386682:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787863066.386684:0:23770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787863066.386686:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863066.387343:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.387344:0:23770:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787863066.387349:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863066.387352:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.387353:0:23770:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787863066.387356:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787863066.387392:0:23770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23770:1874709526518912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787863066.387488:0:23770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.387549:0:23770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65099796c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863066.387824:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526518912 00000100:00100000:1.0:1787863066.387832:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526518912 00000100:00100000:1.0:1787863066.387875:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787863066.387885:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23770:x1874709526518912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787863066.388345:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526518784:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787863066.388385:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526518784 offset 0 length 520: 4 00000100:00100000:1.0:1787863066.389460:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23770:x1874709526518912:12345-0@lo:502:llog_process_th.0 Request processed in 1575us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863066.389477:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787863066.390090:0:23770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23770:1874709526518912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787863066.390126:0:23770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863066.390134:0:23770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863066.390136:0:23770:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787863066.390141:0:23770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787863066.390278:0:23734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787863066.390321:0:23734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787863066.390347:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893171a expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.390357:0:23734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd000/0x9c5536ccf8931713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893171a expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787863066.390365:0:23734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6527360000 from 1 10000000:01000000:0.0:1787863066.390368:0:23734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787863066.390403:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.390410:0:23734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.390419:0:23734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863066.390441:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787863066.390485:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863066.390529:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517ba6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.390599:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519040 00000100:00100000:2.0:1787863066.390605:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519040 00000100:00100000:2.0:1787863066.390653:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787863066.390681:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+9:23734:x1874709526519040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863066.390693:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863066.390715:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931791 expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.390739:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 10 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.390750:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 10 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.390758:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16800, rc 0) 00000100:00100000:2.0:1787863066.390806:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+10:23734:x1874709526519040:12345-0@lo:101:mount.lustre.0 Request processed in 127us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.390812:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787863066.391449:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863066.391469:0:23734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.391479:0:23734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863066.392021:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519168:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787863066.392099:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.392139:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65115939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787863066.392148:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519168 00000100:00100000:0.0:1787863066.392155:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519168 00000100:00100000:0.0:1787863066.392206:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787863066.392215:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+10:23734:x1874709526519168:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787863066.392236:0:23746:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787863066.392249:0:23746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787863066.392324:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+10:23734:x1874709526519168:12345-0@lo:256:mount.lustre.0 Request processed in 110us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863066.392331:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787863066.392370:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519168:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787863066.393126:0:23734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787863066.393192:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.393213:0:23734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863066.393221:0:23734:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6527360000 from 1 10000000:01000000:1.0:1787863066.393224:0:23734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787863066.393257:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.393264:0:23734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.393284:0:23734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863066.393302:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787863066.393343:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.393376:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65115939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.393503:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519296 00000100:00100000:2.0:1787863066.393510:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519296 00000100:00100000:2.0:1787863066.393554:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787863066.393562:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+10:23734:x1874709526519296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863066.393574:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863066.393588:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf893179f expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.393608:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf893179f expref: 11 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.393621:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf893179f expref: 11 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.393640:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17000, rc 0) 00000100:00100000:2.0:1787863066.393702:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526519296:12345-0@lo:101:mount.lustre.0 Request processed in 133us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.393710:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787863066.393848:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863066.393861:0:23734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.393872:0:23734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863066.393924:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863066.393948:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.393972:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65115939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787863066.394100:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519424 00000100:00100000:0.0:1787863066.394105:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519424 00000100:00100000:0.0:1787863066.394134:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787863066.394141:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526519424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787863066.394603:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526519424:12345-0@lo:501:mount.lustre.0 Request processed in 462us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863066.394611:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787863066.394830:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863066.394863:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787863066.394905:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.394939:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65115939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.395073:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519552 00000100:00100000:2.0:1787863066.395078:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519552 00000100:00100000:2.0:1787863066.395104:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787863066.395111:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526519552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787863066.395350:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526519552:12345-0@lo:503:mount.lustre.0 Request processed in 240us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.395357:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787863066.395524:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787863066.396471:0:23778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23778:1874709526519680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787863066.396529:0:23778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.396597:0:23778:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6511245c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.396636:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519680 00000100:00100000:2.0:1787863066.396643:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519680 00000100:00100000:2.0:1787863066.396783:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787863066.396793:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23778:x1874709526519680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787863066.397099:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23778:x1874709526519680:12345-0@lo:502:llog_process_th.0 Request processed in 307us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.397107:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787863066.397386:0:23778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23778:1874709526519680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787863066.397413:0:23778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863066.397423:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.397425:0:23778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787863066.397432:0:23778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6527360000 00000020:00000080:1.0:1787863066.397435:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787863066.397442:0:23778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863066.397445:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.397446:0:23778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787863066.397448:0:23778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863066.397450:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.397451:0:23778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787863066.397455:0:23778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6527360000 00000020:00000080:1.0:1787863066.397457:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787863066.397516:0:23778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863066.397520:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.397522:0:23778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787863066.397524:0:23778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863066.397527:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863066.397528:0:23778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787863066.397532:0:23778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6527360000 00000020:00000080:1.0:1787863066.397534:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787863066.397568:0:23778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23778:1874709526519808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787863066.397605:0:23778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.397787:0:23778:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65115939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.399833:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519808 00000100:00100000:2.0:1787863066.399847:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519808 00000100:00100000:2.0:1787863066.399905:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787863066.399915:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23778:x1874709526519808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787863066.400191:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23778:x1874709526519808:12345-0@lo:502:llog_process_th.0 Request processed in 277us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.400279:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787863066.401349:0:23778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23778:1874709526519808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787863066.401388:0:23778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787863066.401397:0:23778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787863066.401399:0:23778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787863066.401405:0:23778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787863066.402447:0:23734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787863066.402471:0:23734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787863066.402490:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.402501:0:23734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863066.402555:0:23734:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787863066.402558:0:23734:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6527360000 10000000:01000000:3.0:1787863066.402561:0:23734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6527360000 10000000:01000000:3.0:1787863066.402566:0:23734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787863066.402572:0:23734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6527360000 from 1 10000000:01000000:3.0:1787863066.402575:0:23734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787863066.402613:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.402633:0:23734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.402643:0:23734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863066.403301:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787863066.403381:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.403425:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509979240 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.403844:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526519936 00000100:00100000:2.0:1787863066.403853:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526519936 00000100:00100000:2.0:1787863066.403906:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787863066.403916:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526519936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863066.403932:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863066.403951:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a16c00/0x9c5536ccf89317b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89317ad expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.403979:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a16c00/0x9c5536ccf89317b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89317ad expref: 12 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.403990:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a16c00/0x9c5536ccf89317b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89317ad expref: 12 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863066.404009:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16c00, rc 0) 00000100:00100000:2.0:1787863066.404079:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23734:x1874709526519936:12345-0@lo:101:mount.lustre.0 Request processed in 164us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.404085:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787863066.404340:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526519936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787863066.404357:0:23734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317b4 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.404366:0:23734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89317b4 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863066.404427:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526520064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863066.404457:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.404490:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509979240 going to sleep for 11 seconds 00000100:00100000:2.0:1787863066.405417:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520064 00000100:00100000:2.0:1787863066.405424:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520064 00000100:00100000:2.0:1787863066.405465:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787863066.405473:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23734:x1874709526520064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863066.405958:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23734:x1874709526520064:12345-0@lo:501:mount.lustre.0 Request processed in 484us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.405972:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787863066.406343:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526520064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863066.406393:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526520192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863066.408890:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863066.408947:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509979240 going to sleep for 11 seconds 00000100:00100000:1.0:1787863066.410156:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520192 00000100:00100000:1.0:1787863066.410169:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520192 00000100:00100000:1.0:1787863066.410252:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787863066.410264:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23734:x1874709526520192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787863066.410503:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23734:x1874709526520192:12345-0@lo:503:mount.lustre.0 Request processed in 240us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863066.410519:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787863066.410723:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526520192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787863066.417095:0:23781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23781:1874709526520320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787863066.417188:0:23781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.417242:0:23781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c205540 going to sleep for 11 seconds 00000100:00100000:3.0:1787863066.417359:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520320 00000100:00100000:3.0:1787863066.417373:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520320 00000100:00100000:3.0:1787863066.417425:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787863066.417435:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23781:x1874709526520320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787863066.417897:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23781:x1874709526520320:12345-0@lo:502:llog_process_th.0 Request processed in 462us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863066.417906:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787863066.418012:0:23781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23781:1874709526520320:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787863066.418104:0:23781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787863066.418120:0:23781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a653aa28000) 00000020:00000080:1.0:1787863066.418142:0:23781:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787863066.418236:0:23781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6527360000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787863066.418242:0:23781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6527360000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787863066.418245:0:23781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6527360000 4 00010000:00080000:1.0:1787863066.418277:0:23781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a65117b7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1787863066.424188:0:23781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787863066.426378:0:23781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787863066.426432:0:23781:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787863066.426448:0:23781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c5536ccf89317c2 00000100:00080000:1.0:1787863066.426461:0:23781:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787863066.426467:0:23781:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a65117b7800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787863066.426507:0:23781:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6516829a40 x1874709526520448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787863066.426540:0:23781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787863066.427334:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526520448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787863066.427421:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.429813:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520448 00000100:00100000:1.0:1787863066.429827:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520448 00000100:00100000:1.0:1787863066.429873:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787863066.429881:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526520448:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787863066.429968:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526520448:12345-0@lo:38:llog_process_th.0 Request processed in 86us (2546us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787863066.429980:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787863066.430055:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787863066.430064:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65117b7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787863066.430069:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787863066.430072:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526520448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787863066.431338:0:23781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23781:1874709526520576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787863066.431403:0:23781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.431442:0:23781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6403015780 going to sleep for 11 seconds 00000100:00100000:3.0:1787863066.432824:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520576 00000100:00100000:3.0:1787863066.432834:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520576 00000100:00100000:3.0:1787863066.432900:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787863066.432911:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23781:x1874709526520576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787863066.433251:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23781:x1874709526520576:12345-0@lo:502:llog_process_th.0 Request processed in 341us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863066.433260:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787863066.434395:0:23781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23781:1874709526520576:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787863066.434433:0:23781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787863066.434952:0:23734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787863066.434976:0:23734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787863066.434993:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317b4 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863066.435018:0:23734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc200/0x9c5536ccf89317ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317b4 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787863066.435851:0:23734:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787863066.435855:0:23734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787863066.435856:0:23734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787863066.436294:0:23734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787863066.436297:0:23734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787863066.436299:0:23734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787863066.436300:0:23734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787863066.436302:0:23734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787863066.436304:0:23734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787863066.436305:0:23734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787863066.436309:0:23734:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787863066.436312:0:23734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787863066.436313:0:23734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787863066.436322:0:23734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787863066.436323:0:23734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787863066.436324:0:23734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787863066.436324:0:23734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787863066.436325:0:23734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787863066.436326:0:23734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787863066.436327:0:23734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787863066.436328:0:23734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787863066.436357:0:23734:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787863066.436378:0:23734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526520704:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787863066.436452:0:23734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863066.436495:0:23734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a6d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787863066.436617:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520704 00000100:00100000:3.0:1787863066.436624:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520704 00000100:00100000:3.0:1787863066.436680:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787863066.436690:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23734:x1874709526520704:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787863066.436809:0:23747:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787863066.436825:0:23747:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787863066.504930:0:23747:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787863066.504949:0:23747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787863066.505111:0:23768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787863066.505118:0:23768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787863066.505146:0:23768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.505167:0:23768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 12 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.505176:0:23768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.505285:0:23768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 12 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.505302:0:23768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 12 pid: 23745 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863066.505317:0:23768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23768:1874709526520832:0@lo:104: 00000100:00100000:1.0:1787863066.505401:0:23768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.505453:0:23768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a64030156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787863066.505830:0:23735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520832 00000100:00100000:3.0:1787863066.505838:0:23735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520832 00000100:00100000:3.0:1787863066.505893:0:23735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787863066.505902:0:23735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:23768:x1874709526520832:12345-0@lo:104: 00010000:00010000:3.0:1787863066.505916:0:23735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863066.505979:0:23735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787863066.505986:0:23735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:23768:x1874709526520832:12345-0@lo:104: Request processed in 85us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863066.505993:0:23735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787863066.506311:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863066.506320:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506328:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863066.506332:0:23741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506340:0:23741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863066.506347:0:23741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863066.506353:0:23741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787863066.506387:0:23741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506393:0:23741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787863066.506413:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506420:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf8931791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931798 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506439:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863066.506441:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863066.506442:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863066.506472:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526520960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863066.506513:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863066.506575:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526520960 00000100:00100000:1.0:1787863066.506579:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526520960 00010000:00010000:1.0:1787863066.506596:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 13 pid: 23745 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863066.506618:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787863066.506624:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+13:3281:x1874709526520960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863066.506633:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863066.506638:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 13 pid: 23745 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506648:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 13 pid: 23745 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506846:0:23737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506913:0:23737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787863066.506933:0:23737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001816010s 00010000:00010000:1.0:1787863066.506938:0:23737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506946:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506954:0:23737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506971:0:23737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506977:0:23737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863066.506981:0:23737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.506989:0:23737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.507007:0:23737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.507018:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863066.507298:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+13:3281:x1874709526520960:12345-0@lo:103:ldlm_bl.0 Request processed in 672us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863066.507306:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787863066.507354:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8931791 expref: 12 pid: 23745 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863066.507367:0:23768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23768:1874709526520832:0@lo:104: 00010000:00010000:1.0:1787863066.507386:0:23768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.507395:0:23768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.507400:0:23768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863066.507417:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b79400/0x9c5536ccf89317c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863066.509555:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526520960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787863066.516522:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23734:x1874709526520704:12345-0@lo:253:mount.lustre.0 Request processed in 79821us (80057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863066.516551:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787863066.516800:0:23734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23734:1874709526520704:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787863066.516819:0:23734:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787863066.516823:0:23734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787863066.516825:0:23734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787863066.516827:0:23734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787863066.516828:0:23734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787863066.516829:0:23734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787863066.516831:0:23734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787863066.516832:0:23734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787863066.516834:0:23734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787863066.516835:0:23734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787863066.516837:0:23734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787863066.516869:0:23734:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787863066.525442:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787863066.525724:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787863066.526023:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787863066.526469:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787863066.526950:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787863066.527359:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787863066.529467:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787863066.529852:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787863066.530179:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787863066.530502:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787863066.530983:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787863066.531443:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787863066.567629:0:23734:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:0.0:1787863066.568499:0:23734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787863066.568977:0:23791:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787863066.569103:0:23791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787863066.574639:0:23790:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:2.0:1787863066.574648:0:23790:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:00080000:0.0:1787863066.576283:0:23791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787863066.576357:0:23791:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787863066.576362:0:23791:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787863066.577519:0:23734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787863066.577893:0:23734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787863066.578602:0:23734:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787863066.578614:0:23734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787863066.578974:0:23734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787863066.581311:0:23734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787863066.582189:0:23734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787863066.582378:0:23734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787863066.585392:0:23734:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1787863066.593861:0:23734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1787863066.637105:0:23734:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787863066.637163:0:23734:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf15018cb988 00100000:10000000:0.0:1787863066.637172:0:23734:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787863066.639011:0:23734:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787863066.639033:0:23734:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787863066.639100:0:23734:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787863066.639131:0:23734:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787863067.039251:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787863067.485779:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787863067.804306:0:23749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787863067.804316:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6527360000 from 9 10000000:01000000:1.0:1787863067.804322:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787863067.804378:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863067.804392:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863067.804404:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863067.804435:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526521088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787863067.804518:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863067.804642:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a6d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787863067.804773:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526521088 00000100:00100000:3.0:1787863067.804782:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526521088 00000100:00100000:3.0:1787863067.804839:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787863067.804849:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23749:x1874709526521088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787863067.804863:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863067.804878:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89317d0 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863067.804903:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 12 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863067.804914:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 12 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863067.804923:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:3.0:1787863067.804983:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526521088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863067.805017:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787863067.805198:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526521088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787863067.805230:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863067.805239:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863067.805289:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526521216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787863067.805324:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863067.805659:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526521216 00000100:00100000:2.0:1787863067.805666:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526521216 00000100:00100000:2.0:1787863067.805752:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787863067.805761:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526521216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787863067.805778:0:23747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787863067.805800:0:23747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787863067.805803:0:23747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787863067.805888:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526521216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863067.805896:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787863067.806174:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787863067.806195:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526521216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787863067.806252:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787863067.806260:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863067.806270:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863068.060364:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787863068.509545:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787863069.084485:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863070.116509:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863071.136270:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787863071.903273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787863071.903287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787863071.903290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787863071.903308:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787863071.903312:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787863071.903316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787863071.903322:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a65117b7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787863071.903337:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a65117b7800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863071.903375:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3f840 x1874709526521472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787863071.903490:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526521344:0@lo:400:kworker.0 00000100:00100000:0.0:1787863071.903804:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526521472:0@lo:38:kworker.0 00000100:00100000:0.0:1787863071.903882:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863071.904202:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526521472 00000100:00100000:3.0:1787863071.904213:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526521472 00000100:00100000:3.0:1787863071.904263:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787863071.904272:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526521472:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787863071.904311:0:23754:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:3.0:1787863071.904359:0:23754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c5536ccf89317de 00000004:00100000:3.0:1787863071.904381:0:23754:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787863071.904577:0:23754:0:(import.c:65:import_set_state_nolock()) ffff9a651f8d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787863071.904584:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863071.904710:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526521344 00000100:00100000:1.0:1787863071.904718:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526521344 00000100:00100000:1.0:1787863071.904786:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787863071.904799:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:3282:x1874709526521344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863071.911192:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874709526521472:12345-0@lo:38:kworker.0 Request processed in 6892us (7283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863071.911215:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787863071.912536:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6401b3f840 x1874709526521472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787863081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787863071.912567:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787863071.912580:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787863071.912586:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787863071.912592:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65117b7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787863071.912604:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526521472:0@lo:38:kworker.0 00000100:00100000:1.0:1787863071.913000:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:3282:x1874709526521344:12345-0@lo:400:kworker.0 Request processed in 8190us (9381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863071.913032:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787863071.913901:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526521344:0@lo:400:kworker.0 00010000:00010000:1.0:1787863072.156807:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787863072.807625:0:24034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787863073.194811:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863074.207129:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863075.231333:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863076.252340:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787863076.746736:0:24184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff91d2c190 20000000:00000080:3.0:1787863076.746755:0:24184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6505810400 uarg=0000000000000000 20000000:01000000:3.0:1787863076.746790:0:24184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787863076.746797:0:24184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787863076.746802:0:24184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787863076.748093:0:24185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787863076.748254:0:24184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787863076.755021:0:24184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787863076.757229:0:24184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863076.757253:0:24184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf893179f expref: 11 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863076.757262:0:24184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863076.757304:0:24184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf893179f expref: 11 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863076.757319:0:24184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf893179f expref: 11 pid: 23747 timeout: 902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863076.757334:0:24184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24184:1874709526521600:0@lo:104: 00000100:00100000:3.0:1787863076.757421:0:24184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863076.757480:0:24184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65091496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863076.757501:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526521600 00000100:00100000:1.0:1787863076.757508:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526521600 00000100:00100000:1.0:1787863076.757563:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863076.757576:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:24184:x1874709526521600:12345-0@lo:104: 00010000:00010000:1.0:1787863076.757589:0:23736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.757669:0:23736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787863076.757676:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:24184:x1874709526521600:12345-0@lo:104: Request processed in 102us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863076.757682:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787863076.757703:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863076.757709:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.757716:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78400 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863076.757720:0:23740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.757728:0:23740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863076.757735:0:23740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863076.757755:0:23740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787863076.757789:0:23740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.757796:0:23740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787863076.757813:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.757819:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6401b78400/0x9c5536ccf893179f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317a6 expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.757835:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863076.757837:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863076.757838:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863076.757856:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526521728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863076.757885:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863076.757930:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526521728 00000100:00100000:1.0:1787863076.757934:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526521728 00010000:00010000:1.0:1787863076.757950:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf893179f expref: 12 pid: 23747 timeout: 902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863076.757972:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863076.757978:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:3283:x1874709526521728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863076.757988:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863076.757992:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf893179f expref: 12 pid: 23747 timeout: 902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758002:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf893179f expref: 12 pid: 23747 timeout: 902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758024:0:23737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758031:0:23737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758077:0:23737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758085:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758092:0:23737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758099:0:23737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758104:0:23737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863076.758108:0:23737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758116:0:23737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758124:0:23737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863076.758132:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863076.758162:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:3283:x1874709526521728:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863076.758176:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863076.758214:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526521728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787863076.759007:0:24184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6510a17000/0x9c5536ccf89317a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf893179f expref: 11 pid: 23747 timeout: 902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863076.759025:0:24184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24184:1874709526521600:0@lo:104: 00010000:00010000:0.0:1787863076.759171:0:24184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863076.759182:0:24184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863076.759199:0:24184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863076.759205:0:24184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfce00/0x9c5536ccf89317e5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863077.020495:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787863066/real 1787863066] req@ffff9a6401b3da40 x1874709526518784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863077.020538:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6401b3da40 x1874709526518784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863077.020550:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787863066/real 1787863066] req@ffff9a6516828f00 x1874709526518528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863077.020562:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6516828f00 x1874709526518528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787863077.020581:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787863077.020607:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787863077.020611:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526518784:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787863077.020617:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6509a24000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787863077.020623:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787863077.020626:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526518528:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787863077.024655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787863077.024667:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787863077.024671:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6509a24000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787863077.024680:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 792 00000100:00080000:3.0:1787863077.024687:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787863077.024695:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6509a24000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863077.024741:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3f0c0 x1874709526521856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787863077.024774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787863077.024777:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787863077.024779:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787863077.024801:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 792 00000100:00080000:3.0:1787863077.024804:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787863077.024808:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6527d3a000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863077.024820:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3c3c0 x1874709526521984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787863077.024870:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526522112:0@lo:400:kworker.0 00000100:00100000:3.0:1787863077.024953:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863077.025079:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522112 00000100:00100000:3.0:1787863077.025087:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522112 00000100:00100000:3.0:1787863077.025134:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787863077.025144:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526522112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863077.025205:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526522112:12345-0@lo:400:kworker.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863077.025212:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787863077.025248:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6401b3cf00 x1874709526522112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863077.025261:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526522112:0@lo:400:kworker.0 00000100:00100000:2.0:1787863077.025446:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526521856:0@lo:8:kworker.0 00000400:00000100:2.0:1787863077.025488:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526521856 offset 0 length 520: 4 00000100:00100000:2.0:1787863077.025511:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526521984:0@lo:8:kworker.0 00000400:00000100:2.0:1787863077.025524:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526521984 offset 0 length 520: 4 00010000:00010000:2.0:1787863077.276159:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787863078.044438:0:23749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787863078.044448:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6527360000 from 10 10000000:01000000:2.0:1787863078.044456:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787863078.044515:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863078.044529:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863078.044541:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863078.044570:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526522240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787863078.044661:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863078.044720:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863078.044820:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522240 00000100:00100000:1.0:1787863078.044829:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522240 00000100:00100000:1.0:1787863078.044898:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787863078.044908:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+11:23749:x1874709526522240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787863078.044923:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863078.044941:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89317ec expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863078.044983:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 12 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863078.044995:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 12 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863078.045005:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79c00, rc 0) 00000100:00100000:1.0:1787863078.045142:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526522240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863078.045149:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787863078.045196:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526522240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787863078.045213:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863078.045221:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863078.045275:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526522368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787863078.045301:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863078.045321:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650910a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863078.045405:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522368 00000100:00100000:1.0:1787863078.045409:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522368 00000100:00100000:1.0:1787863078.045433:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787863078.045439:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526522368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787863078.045939:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526522368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 498us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863078.045956:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787863078.048474:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526522368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787863078.048537:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526522496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787863078.048691:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863078.048767:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863078.048935:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522496 00000100:00100000:1.0:1787863078.048942:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522496 00000100:00100000:1.0:1787863078.048997:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787863078.049008:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526522496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787863078.049492:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:23749:x1874709526522496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 483us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863078.049501:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787863078.049738:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526522496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787863078.050796:0:24236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787863078.050938:0:23749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787863078.050961:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787863078.050972:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863078.050985:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863078.301926:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787863078.757926:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787863079.326728:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863080.353613:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863081.372326:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787863082.143509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787863082.143517:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787863082.143521:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787863082.143524:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787863082.143573:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526522624:0@lo:400:kworker.0 00000100:00100000:1.0:1787863082.143688:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863082.143751:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787863082.143758:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526522752:0@lo:400:kworker.0 00000100:00100000:1.0:1787863082.143788:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863082.143830:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522624 00000100:00100000:1.0:1787863082.143838:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522624 00000100:00100000:1.0:1787863082.143900:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787863082.143910:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:3281:x1874709526522624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863082.143974:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:3281:x1874709526522624:12345-0@lo:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863082.143990:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787863082.144031:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522752 00000100:00100000:1.0:1787863082.144035:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522752 00000100:00100000:1.0:1787863082.144087:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863082.144095:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526522752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863082.144128:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526522752:12345-0@lo:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863082.144134:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787863082.144173:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a651682b480 x1874709526522752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863082.144189:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526522752:0@lo:400:kworker.0 00000100:00100000:1.0:1787863082.144199:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526522624:0@lo:400:kworker.0 00010000:00010000:3.0:1787863082.407956:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787863082.833365:0:24433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787863082.833369:0:24433:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787863082.833500:0:24433:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a651fe85000 00000020:01000004:2.0:1787863082.833516:0:24433:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787863082.833531:0:24433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787863082.833546:0:24433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a6403270000) 00000020:00000080:2.0:1787863082.833565:0:24433:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787863082.859025:0:24433:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787863082.859493:0:24433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787863082.861279:0:24433:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787863082.861538:0:24433:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787863082.861872:0:24433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:3.0:1787863082.862512:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1787863082.862685:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1787863082.862774:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1787863082.863950:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 718: rc = 0 00100000:10000000:3.0:1787863082.864262:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 718: rc = 0 00100000:10000000:3.0:1787863082.864496:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 718: rc = 0 00100000:10000000:3.0:1787863082.866206:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 718: rc = 0 00100000:10000000:3.0:1787863082.866515:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 718: rc = 0 00100000:10000000:3.0:1787863082.866785:0:24433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 718: rc = 0 00000020:00000080:3.0:1787863082.867400:0:24433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787863082.867426:0:24433:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787863082.867441:0:24433:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c5536ccf8931801 00000020:01000004:3.0:1787863082.867449:0:24433:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787863082.867471:0:24433:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787863082.867475:0:24433:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787863082.867481:0:24433:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787863082.867485:0:24433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787863082.867496:0:24433:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a640328ced8) 00000020:00000080:3.0:1787863082.867509:0:24433:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787863082.875138:0:24433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787863082.875912:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787863082.875921:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787863082.880360:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787863082.880375:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787863082.883956:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787863082.883970:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787863082.890957:0:24433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787863082.891914:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787863082.891922:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787863082.893640:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787863082.893653:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787863082.931880:0:24433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787863082.932739:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787863082.932748:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787863082.935927:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787863082.935949:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787863082.937879:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787863082.937894:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787863082.941688:0:24433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787863082.941987:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787863082.941995:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787863082.948921:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787863082.949128:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787863083.024984:0:24433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787863083.025248:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787863083.025256:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787863083.041858:0:24433:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787863083.041871:0:24433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787863083.044331:0:24433:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787863083.044370:0:24433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787863083.044377:0:24433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787863083.076637:0:24433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787863083.076688:0:24433:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787863083.076693:0:24433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787863083.076696:0:24433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787863083.076698:0:24433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863083.076700:0:24433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863083.076701:0:24433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863083.076702:0:24433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863083.076704:0:24433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787863083.076707:0:24433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863083.076713:0:24433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787863083.076717:0:24433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787863083.076720:0:24433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787863083.076721:0:24433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787863083.076722:0:24433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863083.076723:0:24433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863083.076724:0:24433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863083.076725:0:24433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863083.076726:0:24433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787863083.076727:0:24433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863083.076728:0:24433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787863083.076774:0:24433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787863083.076800:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526522880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787863083.077334:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.077388:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.077468:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526522880 00000100:00100000:1.0:1787863083.077480:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526522880 00000100:00100000:1.0:1787863083.077552:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787863083.077562:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:24433:x1874709526522880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787863083.077601:0:23746:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787863083.077605:0:23746:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787863083.077609:0:23746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787863083.089389:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:24433:x1874709526522880:12345-0@lo:253:mount.lustre.0 Request processed in 11818us (12046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863083.089406:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787863083.089518:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526522880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787863083.089535:0:24433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787863083.089538:0:24433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787863083.089540:0:24433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787863083.089556:0:24433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787863083.089558:0:24433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787863083.089559:0:24433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787863083.089560:0:24433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787863083.089562:0:24433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787863083.089564:0:24433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787863083.089565:0:24433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787863083.089588:0:24433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a651fe85000 from lustre-OST0000 10000000:01000000:1.0:1787863083.089615:0:24433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787863083.089618:0:24433:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787863083.089625:0:24433:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6403288000 local copy 00010000:00010000:1.0:1787863083.089635:0:24433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863083.089887:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863083.089932:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863083.089971:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc42cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863083.090108:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523008 00000100:00100000:2.0:1787863083.090115:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523008 00000100:00100000:2.0:1787863083.090161:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787863083.090171:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:24433:x1874709526523008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863083.090345:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:24433:x1874709526523008:12345-0@lo:501:mount.lustre.0 Request processed in 175us (411us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787863083.090353:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787863083.090506:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523008:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787863083.090533:0:24433:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787863083.090689:0:24433:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787863083.090696:0:24433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.090706:0:24433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863083.090727:0:24433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a651fe85000 10000000:01000000:3.0:1787863083.090732:0:24433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787863083.090736:0:24433:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a6403288000 10000000:01000000:3.0:1787863083.090738:0:24433:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787863083.090742:0:24433:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a6403288000 from 1 10000000:01000000:3.0:1787863083.090745:0:24433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787863083.090771:0:24433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.090779:0:24433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.090787:0:24433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863083.090802:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787863083.090835:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863083.090879:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6533e083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.091079:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523136 00000100:00100000:1.0:1787863083.091084:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523136 00000100:00100000:1.0:1787863083.091184:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787863083.091193:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+12:24433:x1874709526523136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863083.091203:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863083.091219:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b79000/0x9c5536ccf8931816 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf893180f expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.091243:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b79000/0x9c5536ccf8931816 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf893180f expref: 13 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.091253:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b79000/0x9c5536ccf8931816 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf893180f expref: 13 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.091261:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79000, rc 0) 00000100:00100000:1.0:1787863083.091314:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+13:24433:x1874709526523136:12345-0@lo:101:mount.lustre.0 Request processed in 122us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.091320:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787863083.091369:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787863083.091386:0:24433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931816 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863083.091396:0:24433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931816 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787863083.091427:0:24433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787863083.091448:0:24433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931816 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863083.091456:0:24433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf893180f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931816 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787863083.091461:0:24433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787863083.091466:0:24433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787863083.091471:0:24433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787863083.091473:0:24433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787863083.091489:0:24433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863083.091497:0:24433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863083.091505:0:24433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863083.091521:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787863083.091559:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863083.091587:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a14600 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.091629:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523264 00000100:00100000:1.0:1787863083.091634:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523264 00000100:00100000:1.0:1787863083.091673:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787863083.091680:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+13:24433:x1874709526523264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863083.091688:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863083.091697:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b78800/0x9c5536ccf8931824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf893181d expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.091712:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b78800/0x9c5536ccf8931824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf893181d expref: 14 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.091721:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b78800/0x9c5536ccf8931824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf893181d expref: 14 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.091726:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78800, rc 0) 00000100:00100000:1.0:1787863083.091765:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523264:12345-0@lo:101:mount.lustre.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.091771:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787863083.091827:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787863083.091840:0:24433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931824 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863083.091859:0:24433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931824 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787863083.092673:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787863083.096464:0:24433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787863083.096799:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787863083.096868:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787863083.096907:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787863083.096958:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787863083.096994:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787863083.097024:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787863083.098087:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787863083.098226:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787863083.098266:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787863083.098322:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787863083.098360:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787863083.098433:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787863083.098507:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787863083.098516:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787863083.098626:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863083.098698:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863083.099971:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.102471:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523392 00000100:00100000:3.0:1787863083.102490:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523392 00000100:00100000:3.0:1787863083.102561:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787863083.102571:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863083.103595:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523392:12345-0@lo:501:mount.lustre.0 Request processed in 1024us (4895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.103607:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787863083.103677:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863083.103733:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787863083.103779:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.103817:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598240 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.104014:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523520 00000100:00100000:3.0:1787863083.104020:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523520 00000100:00100000:3.0:1787863083.104088:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787863083.104159:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863083.104484:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523520:12345-0@lo:503:mount.lustre.0 Request processed in 326us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.104493:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787863083.104519:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787863083.105128:0:24433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787863083.105191:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863083.105232:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.105267:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598240 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.105292:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523648 00000100:00100000:1.0:1787863083.105298:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523648 00000100:00100000:1.0:1787863083.105343:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787863083.105352:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787863083.105544:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523648:12345-0@lo:502:mount.lustre.0 Request processed in 193us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.105552:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787863083.105732:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787863083.106012:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787863083.106104:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787863083.106153:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787863083.106201:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787863083.106237:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787863083.106272:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787863083.106319:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787863083.106356:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787863083.106390:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787863083.106438:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787863083.106474:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787863083.106523:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787863083.106553:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787863083.106598:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863083.106637:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6533e08540 going to sleep for 11 seconds 00000100:00100000:2.0:1787863083.106766:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523776 00000100:00100000:2.0:1787863083.106772:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523776 00000100:00100000:2.0:1787863083.106812:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787863083.106820:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863083.106989:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523776:12345-0@lo:502:mount.lustre.0 Request processed in 170us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863083.106997:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787863083.107085:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787863083.107161:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1787863083.107170:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787863083.107975:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787863083.107984:0:24447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787863083.107991:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.107993:0:24447:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787863083.107998:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787863083.108013:0:24447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a640328b490) 00000020:00000080:3.0:1787863083.108037:0:24447:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787863083.108165:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787863083.108240:0:24447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a651fe85000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787863083.108248:0:24447:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787863083.108255:0:24447:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c5536ccf8931832 00010000:00010000:3.0:1787863083.111981:0:24447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787863083.112672:0:24447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787863083.115802:0:24447:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:1.0:1787863083.121672:0:24447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787863083.121687:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863083.121695:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863083.121697:0:24447:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787863083.121702:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787863083.121706:0:24447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787863083.121708:0:24447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787863083.121710:0:24447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787863083.121712:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787863083.121716:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863083.121717:0:24447:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787863083.121720:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863083.121725:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863083.121726:0:24447:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787863083.121738:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787863083.121741:0:24447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787863083.121743:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863083.121747:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863083.121748:0:24447:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787863083.121750:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863083.121754:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863083.121755:0:24447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787863083.121759:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787863083.121806:0:24447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863083.121810:0:24447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863083.121811:0:24447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787863083.121829:0:24447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787863083.122262:0:24433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787863083.122296:0:24433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787863083.122319:0:24433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931824 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.122334:0:24433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf893181d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931824 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787863083.122357:0:24433:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a651fe85000 from 1 10000000:01000000:2.0:1787863083.122361:0:24433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787863083.122405:0:24433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.122414:0:24433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.122426:0:24433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863083.122462:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787863083.122956:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.123016:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598000 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.123032:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526523904 00000100:00100000:3.0:1787863083.123129:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526523904 00000100:00100000:3.0:1787863083.123182:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787863083.123195:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+14:24433:x1874709526523904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787863083.123210:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863083.123225:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931839 expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.123253:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 15 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.123264:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 15 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.123285:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:3.0:1787863083.123332:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526523904:12345-0@lo:101:mount.lustre.0 Request processed in 140us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.123339:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787863083.123452:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526523904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863083.123470:0:24433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.123480:0:24433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787863083.124780:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1787863083.126786:0:24433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787863083.128648:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787863083.128723:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787863083.128776:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787863083.130122:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787863083.130546:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787863083.130624:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787863083.130662:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787863083.130695:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787863083.130782:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787863083.130792:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1787863083.131753:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863083.131969:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.132028:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598000 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.132088:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524032 00000100:00100000:3.0:1787863083.132097:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524032 00000100:00100000:3.0:1787863083.132149:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787863083.132161:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863083.132446:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863083.132485:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863083.132537:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524032:12345-0@lo:501:mount.lustre.0 Request processed in 378us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.132556:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787863083.133533:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.133582:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598000 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.133639:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524160 00000100:00100000:3.0:1787863083.133646:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524160 00000100:00100000:3.0:1787863083.133690:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787863083.133700:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863083.133918:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524160:12345-0@lo:503:mount.lustre.0 Request processed in 218us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.133926:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787863083.133982:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787863083.134750:0:24433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787863083.134826:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863083.134898:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.134936:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598000 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.134953:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524288 00000100:00100000:3.0:1787863083.134960:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524288 00000100:00100000:3.0:1787863083.135001:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787863083.135009:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787863083.135279:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524288:12345-0@lo:502:mount.lustre.0 Request processed in 270us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.135287:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787863083.135393:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787863083.135816:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787863083.135883:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787863083.135935:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787863083.135977:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787863083.136012:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787863083.136219:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787863083.136261:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787863083.136307:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1787863083.136352:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787863083.136406:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863083.136626:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a14600 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.137176:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524416 00000100:00100000:3.0:1787863083.137183:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524416 00000100:00100000:3.0:1787863083.137237:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787863083.137248:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787863083.137489:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524416:12345-0@lo:502:mount.lustre.0 Request processed in 243us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.137498:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787863083.137600:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787863083.137725:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787863083.137746:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787863083.138646:0:24451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863083.138655:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.138658:0:24451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787863083.138663:0:24451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a651fe85000 00000020:00000080:3.0:1787863083.138665:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787863083.138672:0:24451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863083.138674:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.138676:0:24451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787863083.138677:0:24451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863083.138679:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.138680:0:24451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787863083.138683:0:24451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a651fe85000 00000020:00000080:3.0:1787863083.138685:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787863083.138742:0:24451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863083.138745:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.138747:0:24451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787863083.138749:0:24451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863083.138752:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.138753:0:24451:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787863083.138756:0:24451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a651fe85000 00000020:00000080:3.0:1787863083.138758:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787863083.138795:0:24451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863083.138799:0:24451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863083.138800:0:24451:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787863083.138803:0:24451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1787863083.138942:0:24433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787863083.138967:0:24433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787863083.138990:0:24433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.139002:0:24433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863083.139070:0:24433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787863083.139073:0:24433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a651fe85000 10000000:01000000:1.0:1787863083.139077:0:24433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a651fe85000 10000000:01000000:1.0:1787863083.139081:0:24433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787863083.139087:0:24433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a651fe85000 from 1 10000000:01000000:1.0:1787863083.139100:0:24433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787863083.139132:0:24433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.139150:0:24433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.139159:0:24433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863083.139179:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787863083.139233:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863083.139265:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc42cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863083.139453:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524544 00000100:00100000:2.0:1787863083.139460:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524544 00000100:00100000:2.0:1787863083.139504:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787863083.139513:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526524544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863083.139527:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863083.139540:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a17800/0x9c5536ccf893184e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931847 expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.139565:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a17800/0x9c5536ccf893184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931847 expref: 16 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.139576:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a17800/0x9c5536ccf893184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931847 expref: 16 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.139585:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17800, rc 0) 00000100:00100000:2.0:1787863083.139624:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524544:12345-0@lo:101:mount.lustre.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863083.139630:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787863083.142645:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863083.142675:0:24433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893184e expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.142687:0:24433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf893184e expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787863083.144658:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1787863083.151232:0:24433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787863083.151608:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787863083.151654:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787863083.151685:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787863083.151729:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787863083.151766:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787863083.151810:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787863083.151874:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787863083.151911:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787863083.151962:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787863083.151998:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787863083.152080:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787863083.152132:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787863083.152168:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787863083.152199:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787863083.152247:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787863083.152283:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787863083.152314:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787863083.152371:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787863083.152409:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787863083.152443:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787863083.152493:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787863083.152533:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787863083.152584:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787863083.152631:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787863083.152665:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1787863083.152699:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1787863083.152745:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1787863083.152782:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1787863083.152820:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1787863083.156859:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1787863083.156961:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1787863083.156998:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1787863083.157031:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1787863083.157100:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1787863083.157137:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1787863083.157182:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1787863083.159909:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1787863083.159969:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1787863083.160087:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1787863083.160138:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1787863083.160284:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1787863083.160292:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1787863083.160410:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863083.167024:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863083.167128:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.167266:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524672 00000100:00100000:3.0:1787863083.167275:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524672 00000100:00100000:3.0:1787863083.167333:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787863083.167345:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863083.167637:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524672:12345-0@lo:501:mount.lustre.0 Request processed in 294us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.167646:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787863083.167669:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863083.167729:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787863083.167784:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.167805:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.169913:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524800 00000100:00100000:1.0:1787863083.169944:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524800 00000100:00100000:1.0:1787863083.170313:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787863083.170330:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787863083.170729:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524800:12345-0@lo:503:mount.lustre.0 Request processed in 404us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.170740:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787863083.170898:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787863083.171933:0:24433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787863083.172070:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863083.172263:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.172328:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537f6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787863083.175821:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526524928 00000100:00100000:3.0:1787863083.175837:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526524928 00000100:00100000:3.0:1787863083.175927:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787863083.175940:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787863083.176349:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526524928:12345-0@lo:502:mount.lustre.0 Request processed in 411us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.176358:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787863083.176535:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526524928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787863083.176950:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787863083.177012:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787863083.177075:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787863083.177143:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787863083.177179:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787863083.177225:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787863083.177261:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787863083.177293:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787863083.177337:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787863083.177370:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787863083.177397:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787863083.177451:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787863083.177485:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787863083.177514:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787863083.177584:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787863083.177617:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787863083.177645:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787863083.177686:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787863083.177718:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787863083.177746:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787863083.177786:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787863083.177839:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787863083.177882:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787863083.177926:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787863083.177957:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1787863083.177988:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1787863083.178029:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1787863083.178091:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1787863083.178122:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1787863083.178175:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1787863083.178222:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1787863083.178256:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1787863083.178289:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1787863083.178337:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1787863083.178373:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1787863083.178419:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1787863083.178457:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1787863083.178490:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1787863083.178538:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1787863083.178573:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1787863083.178631:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526525056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863083.178728:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863083.178791:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525056 00000100:00100000:2.0:1787863083.178796:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537f6acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.178799:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525056 00000100:00100000:1.0:1787863083.178860:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787863083.178870:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526525056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787863083.179159:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526525056:12345-0@lo:502:mount.lustre.0 Request processed in 289us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.179167:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787863083.180266:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526525056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787863083.180805:0:24433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1787863083.180957:0:24433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787863083.196494:0:24456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787863083.196516:0:24456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a653aa2ced8) 00000020:00000080:1.0:1787863083.196543:0:24456:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787863083.196634:0:24456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a651fe85000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787863083.196638:0:24456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a651fe85000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787863083.196641:0:24456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a651fe85000 3 00010000:00080000:1.0:1787863083.196678:0:24456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a650ac32800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1787863083.199805:0:24456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787863083.200079:0:24456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787863083.200124:0:24456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787863083.200147:0:24456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c5536ccf893185c 00000100:00080000:2.0:1787863083.200158:0:24456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787863083.200172:0:24456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a650ac32800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787863083.200225:0:24456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a653d9bf840 x1874709526525184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787863083.200249:0:24456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787863083.200288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787863083.200293:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787863083.200296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787863083.200298:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787863083.200353:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526525312:0@lo:400:kworker.0 00000100:00100000:2.0:1787863083.200428:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.200493:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525312 00000100:00100000:2.0:1787863083.200499:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525312 00000100:00100000:2.0:1787863083.200540:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787863083.200549:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526525312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863083.200604:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526525312:12345-0@lo:400:kworker.0 Request processed in 55us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863083.200612:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787863083.200651:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a653d9bed00 x1874709526525312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863083.200663:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526525312:0@lo:400:kworker.0 00000100:00100000:1.0:1787863083.201797:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526525184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787863083.201879:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863083.202208:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525184 00000100:00100000:3.0:1787863083.202216:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525184 00000100:00100000:3.0:1787863083.202247:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787863083.202256:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3280:x1874709526525184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787863083.202284:0:23753:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 808 last 0 00000020:00000080:3.0:1787863083.202329:0:23753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c5536ccf8931863 00000004:00100000:3.0:1787863083.202344:0:23753:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787863083.202385:0:23753:0:(import.c:65:import_set_state_nolock()) ffff9a653dae8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787863083.202461:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874709526525184:12345-0@lo:38:llog_process_th.0 Request processed in 206us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863083.202469:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787863083.202535:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a653d9bf840 x1874709526525184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787863093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863083.202561:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787863083.202571:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1787863083.202581:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787863083.202586:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787863083.202589:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a650ac32800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787863083.202596:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526525184:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787863083.203380:0:24456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1787863083.204256:0:24433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787863083.204296:0:24433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787863083.204325:0:24433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893184e expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863083.204338:0:24433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6401b79200/0x9c5536ccf8931847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893184e expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787863083.204410:0:24433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787863083.204413:0:24433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787863083.204414:0:24433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787863083.204415:0:24433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787863083.204417:0:24433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787863083.204418:0:24433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787863083.204420:0:24433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787863083.204422:0:24433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787863083.204423:0:24433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787863083.204427:0:24433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787863083.204429:0:24433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787863083.204431:0:24433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787863083.204432:0:24433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787863083.204434:0:24433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787863083.204435:0:24433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787863083.204436:0:24433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787863083.204437:0:24433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787863083.204438:0:24433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787863083.204439:0:24433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787863083.204468:0:24433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787863083.204490:0:24433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526525440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787863083.204570:0:24433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863083.204621:0:24433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6504f2a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.204694:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525440 00000100:00100000:1.0:1787863083.204702:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525440 00000100:00100000:1.0:1787863083.204762:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787863083.204773:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:24433:x1874709526525440:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787863083.204804:0:23747:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787863083.204817:0:23747:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787863083.251478:0:23747:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787863083.251504:0:23747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787863083.251598:0:23768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787863083.251603:0:23768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787863083.251630:0:23768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.251667:0:23768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 16 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.251676:0:23768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.251737:0:23768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 16 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.251754:0:23768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 16 pid: 23746 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863083.251770:0:23768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23768:1874709526525568:0@lo:104: 00000100:00100000:2.0:1787863083.251864:0:23768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863083.251920:0:23768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537f6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787863083.251941:0:23735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525568 00000100:00100000:1.0:1787863083.251954:0:23735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525568 00000100:00100000:1.0:1787863083.252011:0:23735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787863083.252027:0:23735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:23768:x1874709526525568:12345-0@lo:104: 00010000:00010000:1.0:1787863083.252093:0:23735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.252175:0:23735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787863083.252181:0:23735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:23768:x1874709526525568:12345-0@lo:104: Request processed in 160us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.252190:0:23735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787863083.252218:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863083.252224:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.252244:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79400 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863083.252248:0:23741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.252257:0:23741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863083.252265:0:23741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863083.252271:0:23741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787863083.252306:0:23741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.252313:0:23741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787863083.252343:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.252351:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6401b79400/0x9c5536ccf89317d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317d7 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.252371:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863083.252373:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863083.252376:0:23768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23768:1874709526525568:0@lo:104: 00010000:00010000:1.0:1787863083.252376:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863083.252412:0:23768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863083.252439:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787863083.252452:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526525696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787863083.252482:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863083.252998:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525696 00000100:00100000:1.0:1787863083.253005:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525696 00010000:00010000:1.0:1787863083.253031:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 17 pid: 23746 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863083.253104:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787863083.253121:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:3283:x1874709526525696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863083.253134:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863083.253141:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 17 pid: 23746 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253152:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 17 pid: 23746 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253166:0:23737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf89317d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf89317d0 expref: 17 pid: 23746 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253182:0:23737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253189:0:23737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787863083.253202:0:23737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001816010s 00010000:00010000:1.0:1787863083.253207:0:23737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253213:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253220:0:23737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253226:0:23737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253232:0:23737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863083.253241:0:23737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253248:0:23737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253260:0:23737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863083.253269:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863083.253307:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3283:x1874709526525696:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.253314:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787863083.256222:0:23768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.256242:0:23768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863083.256250:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6510a16200/0x9c5536ccf893186a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863083.256328:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526525696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863083.274168:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:24433:x1874709526525440:12345-0@lo:253:mount.lustre.0 Request processed in 69380us (69581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863083.274320:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787863083.274425:0:24433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:24433:1874709526525440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787863083.274444:0:24433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787863083.274447:0:24433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787863083.274449:0:24433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787863083.274450:0:24433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787863083.274451:0:24433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787863083.274469:0:24433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787863083.274471:0:24433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787863083.274472:0:24433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787863083.274474:0:24433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787863083.274475:0:24433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787863083.274490:0:24433:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787863083.275205:0:24433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787863083.275387:0:24433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787863083.275630:0:24433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787863083.275938:0:24433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787863083.276230:0:24433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1787863083.276398:0:24433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787863083.279491:0:24433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787863083.350170:0:24433:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787863083.350180:0:24433:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787863083.350216:0:24433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787863083.350282:0:24433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787863083.350297:0:24433:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787863083.350328:0:24433:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787863083.420529:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863084.446413:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787863085.285163:0:23749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787863085.285171:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6527360000 from 10 10000000:01000000:2.0:1787863085.285177:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787863085.285221:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863085.285233:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863085.285244:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863085.286728:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526525824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787863085.286797:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863085.286859:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651091a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787863085.287062:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525824 00000100:00100000:0.0:1787863085.287070:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525824 00000100:00100000:0.0:1787863085.287124:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787863085.287132:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+15:23749:x1874709526525824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787863085.287148:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863085.287166:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931871 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863085.287213:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 16 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863085.287225:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 16 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863085.287234:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636a00, rc 0) 00000100:00100000:0.0:1787863085.287290:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:23749:x1874709526525824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863085.287298:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787863085.287447:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526525824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787863085.287463:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863085.287473:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863085.287542:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526525952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787863085.287576:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863085.287614:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651091a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787863085.287765:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526525952 00000100:00100000:0.0:1787863085.287770:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526525952 00000100:00100000:0.0:1787863085.287801:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787863085.287808:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:23749:x1874709526525952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787863085.287834:0:23747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787863085.287853:0:23747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787863085.287856:0:23747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787863085.287930:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:23749:x1874709526525952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863085.287937:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787863085.288178:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526525952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787863085.288240:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787863085.288248:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863085.288257:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863085.472031:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863086.492273:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863087.516272:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787863088.028932:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1787863088.284531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787863088.284539:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787863088.284543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787863088.284547:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787863088.284607:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526526208:0@lo:400:kworker.0 00000100:00100000:3.0:1787863088.284807:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526526080:0@lo:400:kworker.0 00000100:00100000:3.0:1787863088.284878:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863088.285088:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863088.285119:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787863088.285128:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526526336:0@lo:400:kworker.0 00000100:00100000:0.0:1787863088.285158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863088.285289:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526208 00000100:00100000:3.0:1787863088.285297:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526208 00000100:00100000:3.0:1787863088.285337:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526336 00000100:00100000:3.0:1787863088.285341:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526336 00000100:00100000:3.0:1787863088.285374:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787863088.285383:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526526208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863088.285442:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526526208:12345-0@lo:400:kworker.0 Request processed in 60us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863088.285449:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787863088.285466:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787863088.285472:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526526336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863088.285517:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526526336:12345-0@lo:400:kworker.0 Request processed in 45us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863088.285524:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787863088.285571:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651fc603c0 x1874709526526336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863088.285600:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526526336:0@lo:400:kworker.0 00010000:00080000:3.0:1787863088.285634:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651fc62940 x1874709526526208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863088.285829:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526080 00000100:00100000:2.0:1787863088.285834:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526080 00000100:00100000:2.0:1787863088.285867:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787863088.285874:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3281:x1874709526526080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863088.285917:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3281:x1874709526526080:12345-0@lo:400:kworker.0 Request processed in 44us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863088.285924:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787863088.286295:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526526208:0@lo:400:kworker.0 00000100:00080000:0.0:1787863088.286411:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787863088.286518:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526526080:0@lo:400:kworker.0 00010000:00010000:3.0:1787863088.540903:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863089.570924:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863090.590627:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863091.620083:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787863091.637912:0:24800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787863092.444725:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787863077/real 1787863077] req@ffff9a6401b3f0c0 x1874709526521856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863092.444770:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6401b3f0c0 x1874709526521856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863092.444781:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787863077/real 1787863077] req@ffff9a6401b3c3c0 x1874709526521984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787863092.444792:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6401b3c3c0 x1874709526521984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787863092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787863092.444813:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6509a24000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787863092.444832:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787863092.444837:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526521856:0@lo:8:kworker.0 00000100:00080000:3.0:1787863092.444844:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787863092.444849:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787863092.444852:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526521984:0@lo:8:kworker.0 00000100:00100000:3.0:1787863092.446980:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526526464:0@lo:400:kworker.0 00000100:00100000:3.0:1787863092.447161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787863092.447279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787863092.447284:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787863092.447289:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a6509a24000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787863092.447295:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 802 00000100:00080000:0.0:1787863092.447301:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787863092.447308:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6509a24000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787863092.447333:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651fc63840 x1874709526526592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787863092.447351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787863092.447354:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787863092.447356:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787863092.447359:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 802 00000100:00080000:0.0:1787863092.447362:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787863092.447365:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6527d3a000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787863092.447375:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526526592:0@lo:8:kworker.0 00000100:00100000:0.0:1787863092.447418:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863092.447485:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651fc60f00 x1874709526526720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787863092.447521:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526526720:0@lo:8:kworker.0 00000100:00100000:0.0:1787863092.447548:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863092.447597:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787863092.447606:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526526848:0@lo:400:kworker.0 00000100:00100000:0.0:1787863092.447631:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863092.447661:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526848 00000100:00100000:0.0:1787863092.447668:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526848 00000100:00100000:0.0:1787863092.447719:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863092.447727:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526526848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863092.447790:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526526848:12345-0@lo:400:kworker.0 Request processed in 62us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863092.447797:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787863092.447843:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651fc621c0 x1874709526526848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863092.447861:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526526848:0@lo:400:kworker.0 00000100:00100000:0.0:1787863092.447901:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526526976:0@lo:400:kworker.0 00000100:00100000:0.0:1787863092.447925:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863092.447983:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526592 00000100:00100000:0.0:1787863092.447987:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526592 00000100:00100000:0.0:1787863092.448005:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526720 00000100:00100000:0.0:1787863092.448007:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526720 00000100:00100000:0.0:1787863092.448017:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787863092.448021:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526526592:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787863092.448072:0:24435:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 818 last 0 00000020:00000080:0.0:1787863092.448432:0:24435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf893187f 00002000:00100000:0.0:1787863092.448513:0:24435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a651fef4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787863092.448519:0:24435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787863092.448523:0:24435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787863092.448908:0:24435:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787863092.448941:0:24435:0:(import.c:65:import_set_state_nolock()) ffff9a651fef4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863092.449515:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526464 00000100:00100000:2.0:1787863092.449523:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526464 00000100:00100000:2.0:1787863092.449561:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787863092.449569:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3284:x1874709526526464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863092.449689:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874709526526592:12345-0@lo:8:kworker.0 Request processed in 1666us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863092.449698:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787863092.449706:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651fc63840 x1874709526526592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787863112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863092.449715:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863092.449717:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1787863092.449719:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526526720:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1787863092.449726:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787863092.449733:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00020000:0.0:1787863092.449733:0:24435:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787863092.449738:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787863092.449741:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6509a24000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787863092.449765:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787863092.449771:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526526592:0@lo:8:kworker.0 00000100:00100000:2.0:1787863092.454627:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3284:x1874709526526464:12345-0@lo:400:kworker.0 Request processed in 5045us (7454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863092.454643:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787863092.454748:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526526976 00000100:00100000:2.0:1787863092.454786:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526526976 00000100:00100000:2.0:1787863092.454867:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787863092.454877:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526526976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863092.454970:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526526976:12345-0@lo:400:kworker.0 Request processed in 95us (7043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863092.454978:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787863092.455031:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651fc621c0 x1874709526526976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863092.455089:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526526976:0@lo:400:kworker.0 00000100:00100000:3.0:1787863092.465289:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526526464:0@lo:400:kworker.0 00000004:00080000:3.0:1787863092.465392:0:23775:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:3.0:1787863092.465418:0:23775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23775:1874709526527232:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787863092.465506:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526527104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863092.465523:0:23775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863092.468095:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863092.468525:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527104 00000100:00100000:2.0:1787863092.468537:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527104 00000100:00100000:2.0:1787863092.468599:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787863092.468609:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526527104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787863092.468645:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787863092.468730:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526527104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863092.468737:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787863092.469987:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401b3c3c0 x1874709526527104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787863108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863092.470191:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526527104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787863092.471505:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787863092.471515:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787863092.472986:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526526720:12345-0@lo:8:kworker.0 Request processed in 23257us (25428us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787863092.473003:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787863092.473104:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787863092.473110:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787863092.473115:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526526720:0@lo:8:kworker.0 00000100:00100000:0.0:1787863092.473367:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527232 00000100:00100000:0.0:1787863092.473378:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527232 00000100:00100000:0.0:1787863092.473449:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787863092.473461:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23775:x1874709526527232:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787863092.478366:0:23775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510901cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1787863092.478405:0:23774:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787863092.478885:0:23774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818242841417ns, next at 0ns, rc = 0 00002000:00080000:0.0:1787863092.490588:0:24435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787863092.490602:0:24435:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1787863092.490608:0:24435:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:0.0:1787863092.506974:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.506989:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.507019:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.507024:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.507032:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.507112:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.507126:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.507136:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.508915:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.508943:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.508953:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.508967:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.508972:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.508983:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.509021:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.509029:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931886 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.509071:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.509073:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.509074:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.517410:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.517425:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.517446:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.517451:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.521330:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521358:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521372:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521380:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521416:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.521437:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.521444:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521463:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.521469:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521478:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521496:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521504:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf893188d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.521526:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.521528:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.521529:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.522353:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.522362:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522374:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.522385:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.522390:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522401:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522409:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522416:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522435:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.522446:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.522554:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522563:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.522567:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522574:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522588:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522608:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf8931894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.522624:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.522626:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.522627:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.525379:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.525393:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.525409:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.525414:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.525421:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.525435:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.525446:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.525453:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.525798:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.526330:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.526339:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.526350:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.526355:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.526365:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.526391:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.526399:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf893189b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.526435:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.526437:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.526439:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.528519:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.528542:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.528560:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.528565:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.528572:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.528585:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.528595:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.528602:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.529742:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787863092.530978:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.530991:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.531010:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.531016:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.531022:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.531037:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.531079:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.531086:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531224:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787863092.531232:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531240:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.531244:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531253:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531272:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531279:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf89318a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531959:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.531966:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531975:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.531985:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.531994:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.532007:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.532017:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.532018:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.532020:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.538847:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787863092.538864:0:24435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf89318a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.538923:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.539628:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.539639:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539655:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.539659:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.539666:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539680:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539689:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539709:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539729:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.539742:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.539747:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539754:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.539770:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539779:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539797:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539804:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf89318b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.539821:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.539823:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.539824:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.540187:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.540197:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540204:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.540206:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.540209:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540215:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540220:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540225:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540234:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.540241:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.540243:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540247:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.540250:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540257:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540274:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540281:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf89318b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540296:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.540298:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.540300:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.540667:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.540672:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540679:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.540681:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.540684:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540691:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540696:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540701:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540718:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.540724:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.540727:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540732:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.540734:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540739:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540746:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540750:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf89318be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.540778:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.540780:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.540781:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.541193:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.541200:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.541209:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.541220:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.541225:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.541235:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.541243:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.541249:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.541653:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787863092.542239:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.542247:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.542911:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.542916:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.542923:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.542940:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.542950:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.542969:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787863092.543725:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787863092.543781:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787863092.543789:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543800:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.543805:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543816:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543838:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543844:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf89318c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543870:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.543872:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543877:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.543879:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543883:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543890:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.543895:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.543896:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.543898:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.544584:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787863092.544595:0:24435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf89318cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787863092.545396:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.545406:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.545422:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.545427:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.545433:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.545446:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.545645:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.545655:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.545784:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.545793:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.545802:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.545807:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.545828:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.545848:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.545857:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.545859:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.545861:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.546827:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787863092.546839:0:24435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad38744f/0x9c5536ccf89318d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863092.547308:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.548697:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.548712:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.548732:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.548738:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.548746:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.548773:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.548785:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.548793:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.548819:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.549285:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.549293:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.549303:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.549309:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.549318:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.549340:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.549347:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eea1c7b/0x9c5536ccf89318da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.549379:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.549381:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.549382:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.549927:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.549938:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.549965:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.549970:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.549977:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.549989:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.549998:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550224:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550259:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.550281:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.550286:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.550294:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.550298:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.550305:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.550319:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.550327:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9da1606/0x9c5536ccf89318e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.550342:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.550343:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.550345:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.550819:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.550827:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550838:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.550843:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.550849:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550859:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550880:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550887:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.550919:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.551159:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.551166:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.551187:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.551191:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.551210:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.551223:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.551232:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf89318e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.551253:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.551255:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.551256:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.552667:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.552678:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.552733:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.552738:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.552746:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.552786:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.552797:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.552804:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.552841:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.553145:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.553153:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.553163:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.553167:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.553177:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.553279:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.553289:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008883b2b9/0x9c5536ccf89318ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.553312:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.553315:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.553317:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.553743:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.553751:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.553770:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.553774:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.553779:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.553789:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.553797:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.553805:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.553825:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.554341:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.554348:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554357:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.554360:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554369:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554384:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554392:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89318f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554423:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.554425:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.554427:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.554654:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.554662:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.554671:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.554680:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.554687:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.554697:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.554705:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.554713:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.554731:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.554824:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.554830:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554837:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.554841:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554849:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554860:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554868:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acafc027/0x9c5536ccf89318fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.554881:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.554883:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.554885:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.555371:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.555379:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.555387:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.555391:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.555851:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.555867:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.555876:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.555893:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.555919:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787863092.556727:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.556735:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556746:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.556750:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.556766:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556778:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556787:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556794:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556812:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787863092.556823:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787863092.556827:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556840:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.556845:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556853:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556869:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556877:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8931904 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556894:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.556898:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556904:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.556920:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556927:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556936:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.556948:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf893190b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.557175:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.557177:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.557179:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.557410:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.557894:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.557903:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558191:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.558195:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.558201:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558213:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558223:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558229:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558244:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.558265:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.558275:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558284:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.558287:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558296:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558311:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558319:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ffe20d8/0x9c5536ccf8931912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558331:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.558333:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.558335:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.558796:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.558804:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558812:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.558815:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.558818:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558837:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558846:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558852:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.558871:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.559289:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.559297:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.559314:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.559317:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.559326:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.559341:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.559348:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8931919 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.559367:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.559369:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.559371:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.559750:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.559769:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.559778:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.559781:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.559786:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.559795:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.559802:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.559819:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.559840:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.560296:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.560302:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.560310:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.560314:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.560322:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.560373:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.560380:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8931920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.560396:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.560398:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.560400:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.561176:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.561184:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561194:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.561197:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.561203:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561214:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561221:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561228:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.561278:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.561284:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.561292:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.561296:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.561304:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561315:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.561318:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.561324:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8931927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.561351:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.561352:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.561354:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.561823:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.561830:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561845:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.561848:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.561853:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561864:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561872:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561878:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.561903:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.562088:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.562094:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.562101:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.562104:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.562112:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.562125:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.562132:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf893192e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.562148:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.562149:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.562151:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.562731:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.562741:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.562752:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.562767:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.562773:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.562785:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.562808:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.562816:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.562839:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.562979:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.562986:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.563005:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.563009:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.563018:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.563032:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.563038:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3281fbb/0x9c5536ccf8931935 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.563081:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.563083:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.563085:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.563638:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.563645:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563655:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.563658:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.563662:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563672:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563680:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563688:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563716:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787863092.563726:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787863092.563730:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563737:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787863092.563741:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563748:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563772:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563780:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf893193c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.563795:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.563796:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863092.563798:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.564627:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.564636:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.564647:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.564656:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.564662:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.564673:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.564683:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.564690:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.564703:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.564800:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.564807:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.564815:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.564818:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.564827:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.564878:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.564885:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931943 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.564902:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.564904:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.564906:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.565432:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.565442:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.565453:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.565457:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.565462:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.565473:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.565481:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.565495:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.565603:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.565791:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.565797:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.565806:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.565810:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.565819:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.565835:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.565843:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f87d8b0/0x9c5536ccf893194a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.565888:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.565890:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.565892:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.566429:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.566436:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.566444:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.566448:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.566452:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.566462:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.566470:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.566477:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.566498:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863092.566535:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863092.566541:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.566548:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863092.566552:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.566560:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.566572:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.566579:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8931951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863092.566593:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.566595:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863092.566596:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863092.567333:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863092.567341:0:24435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.567356:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=818s v=(0 0) 00010000:00010000:0.0:1787863092.567359:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863092.567364:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.567375:0:24435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.567383:0:24435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.567390:0:24435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863092.567407:0:24435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787863092.567648:0:24435:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:0.0:1787863092.567739:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23775:x1874709526527232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94278us (102213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863092.567749:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787863092.568586:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787863092.568599:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863092.568610:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787863092.568615:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863092.568625:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863092.568644:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863092.568661:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8931958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863092.568682:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863092.568683:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863092.568684:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863092.568873:0:23775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23775:1874709526527232:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787863092.568890:0:23775:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:0.0:1787863092.568941:0:23775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23775:1874709526527360:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787863092.569232:0:23775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863092.569281:0:23775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6504f2a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787863092.569310:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527360 00000100:00100000:0.0:1787863092.569316:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527360 00000100:00100000:0.0:1787863092.569360:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787863092.569368:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23775:x1874709526527360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787863092.569412:0:24437:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:0.0:1787863092.575825:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:23775:x1874709526527360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6447us (6584us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787863092.575842:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787863092.576900:0:23775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23775:1874709526527360:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787863092.576928:0:23775:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:2.0:1787863092.640120:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787863093.569840:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1787863093.569921:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787863093.664306:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787863094.684284:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863095.713909:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863096.735512:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787863097.500597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787863097.500637:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787863097.500641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787863097.500656:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 818 00000100:00080000:1.0:1787863097.500664:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787863097.500676:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6527d3a000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787863097.500721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651682b480 x1874709526527744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787863097.500795:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526527616:0@lo:400:kworker.0 00000100:00100000:1.0:1787863097.500919:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863097.501134:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526528000:0@lo:400:kworker.0 00000100:00100000:0.0:1787863097.501182:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863097.501235:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527616 00000100:00100000:0.0:1787863097.501247:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527616 00000100:00100000:0.0:1787863097.501336:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787863097.501350:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526527616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863097.501416:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526527616:12345-0@lo:400:kworker.0 Request processed in 68us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863097.501424:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787863097.501461:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528000 00000100:00100000:0.0:1787863097.501465:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528000 00000100:00100000:0.0:1787863097.501502:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787863097.501510:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526528000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863097.501552:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526528000:12345-0@lo:400:kworker.0 Request processed in 43us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863097.501561:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787863097.501636:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526527744:0@lo:8:kworker.0 00000100:00100000:0.0:1787863097.501673:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863097.501700:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526527872:0@lo:400:kworker.0 00000100:00100000:0.0:1787863097.501815:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863097.501846:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527744 00000100:00100000:0.0:1787863097.501850:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527744 00000100:00100000:1.0:1787863097.502073:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787863097.502103:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526527616:0@lo:400:kworker.0 00000100:00080000:1.0:1787863097.502137:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787863097.502143:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787863097.502354:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526527488:0@lo:400:kworker.0 00000100:00100000:3.0:1787863097.502410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863097.502442:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526528128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863097.502478:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863097.502552:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527488 00000100:00100000:3.0:1787863097.502557:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527488 00000100:00100000:3.0:1787863097.502598:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787863097.502609:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3284:x1874709526527488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863097.502658:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3284:x1874709526527488:12345-0@lo:400:kworker.0 Request processed in 47us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863097.502668:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787863097.502726:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528128 00000100:00100000:3.0:1787863097.502730:0:24439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528128 00000100:00100000:3.0:1787863097.502756:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787863097.502777:0:24439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526528128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787863097.502822:0:24439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787863097.502865:0:24439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526528128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863097.502871:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787863097.503100:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787863097.503106:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874709526527744:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787863097.503129:0:24437:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1787863097.503291:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651682a1c0 x1874709526528000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863097.503303:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526528000:0@lo:400:kworker.0 00000100:00100000:3.0:1787863097.504654:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526527488:0@lo:400:kworker.0 00000100:00100000:3.0:1787863097.504693:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526528128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787863097.507099:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526527872 00000100:00100000:2.0:1787863097.507115:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526527872 00000100:00100000:2.0:1787863097.507196:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787863097.507568:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526527872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863097.507697:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526527872:12345-0@lo:400:kworker.0 Request processed in 133us (5883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863097.507705:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787863097.507825:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6516829e00 x1874709526527872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787863097.507841:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526527872:0@lo:400:kworker.0 00000100:00100000:0.0:1787863097.521103:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874709526527744:12345-0@lo:8:kworker.0 Request processed in 17976us (19410us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787863097.521127:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787863097.521786:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787863097.521795:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787863097.521800:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526527744:0@lo:8:kworker.0 00010000:00010000:1.0:1787863097.757937:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787863098.268781:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787863098.780430:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863099.804494:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787863100.513870:0:25153:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787863100.513991:0:25153:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787863100.514189:0:25153:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a653d6d1800 00000020:01000004:2.0:1787863100.514208:0:25153:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787863100.514332:0:25153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787863100.514347:0:25153:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6533eeb490) 00000020:00000080:2.0:1787863100.514365:0:25153:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787863100.555336:0:25153:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787863100.555636:0:25153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787863100.558349:0:25153:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787863100.560661:0:25153:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787863100.561334:0:25153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:2.0:1787863100.562555:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 493: rc = 0 00100000:10000000:2.0:1787863100.563560:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 493: rc = 0 00100000:10000000:2.0:1787863100.565029:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 493: rc = 0 00100000:10000000:2.0:1787863100.570219:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1787863100.571087:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787863100.571546:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787863100.572149:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1787863100.572552:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787863100.575296:0:25153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00000020:00000080:0.0:1787863100.582984:0:25153:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787863100.583003:0:25153:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787863100.583021:0:25153:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c5536ccf8931966 00000020:01000004:0.0:1787863100.583031:0:25153:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787863100.583137:0:25153:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787863100.583141:0:25153:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787863100.583148:0:25153:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787863100.583179:0:25153:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787863100.583184:0:25153:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787863100.597529:0:25153:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787863100.597576:0:25153:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.160@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787863100.597581:0:25153:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787863100.597582:0:25153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787863100.597584:0:25153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787863100.597585:0:25153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787863100.597586:0:25153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787863100.597587:0:25153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787863100.597589:0:25153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787863100.597590:0:25153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787863100.597592:0:25153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787863100.597596:0:25153:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787863100.597598:0:25153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787863100.597600:0:25153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787863100.597600:0:25153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787863100.597601:0:25153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787863100.597603:0:25153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787863100.597604:0:25153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787863100.597605:0:25153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787863100.597606:0:25153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787863100.597607:0:25153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787863100.597640:0:25153:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787863100.597664:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787863100.597860:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.597988:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.598497:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528256 00000100:00100000:2.0:1787863100.598507:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528256 00000100:00100000:3.0:1787863100.598805:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787863100.598820:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:25153:x1874709526528256:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787863100.598882:0:23745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787863100.598886:0:23745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787863100.598890:0:23745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787863100.614185:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:25153:x1874709526528256:12345-0@lo:253:mount.lustre.0 Request processed in 15357us (16313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.614202:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787863100.614363:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787863100.614389:0:25153:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787863100.614393:0:25153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787863100.614395:0:25153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787863100.614397:0:25153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787863100.614398:0:25153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787863100.614399:0:25153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787863100.614400:0:25153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787863100.614402:0:25153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787863100.614403:0:25153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787863100.614422:0:25153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787863100.614452:0:25153:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a653d6d1800 from lustre-OST0001 10000000:01000000:1.0:1787863100.614487:0:25153:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787863100.614490:0:25153:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787863100.614500:0:25153:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6403288000 local copy 00010000:00010000:1.0:1787863100.614513:0:25153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863100.615259:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863100.615322:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.615473:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787863100.615791:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528384 00000100:00100000:3.0:1787863100.615802:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528384 00000100:00100000:3.0:1787863100.615855:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787863100.615866:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:25153:x1874709526528384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863100.616189:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:25153:x1874709526528384:12345-0@lo:501:mount.lustre.0 Request processed in 325us (866us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787863100.616198:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787863100.616442:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528384:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787863100.616462:0:25153:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787863100.616629:0:25153:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787863100.616639:0:25153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.616650:0:25153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf89316f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89316fe expref: -99 pid: 23734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863100.616994:0:25153:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a653d6d1800 10000000:01000000:1.0:1787863100.617003:0:25153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787863100.617010:0:25153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787863100.617012:0:25153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787863100.617017:0:25153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787863100.617020:0:25153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787863100.617089:0:25153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.617097:0:25153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.617116:0:25153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863100.617136:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787863100.617183:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.617278:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.617479:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528512 00000100:00100000:2.0:1787863100.617487:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528512 00000100:00100000:2.0:1787863100.617537:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787863100.617546:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:25153:x1874709526528512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863100.617559:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863100.617575:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf893196d expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.617600:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf893196d expref: 17 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.617621:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a16800/0x9c5536ccf8931974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf893196d expref: 17 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.617630:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16800, rc 0) 00000100:00100000:2.0:1787863100.617772:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528512:12345-0@lo:101:mount.lustre.0 Request processed in 225us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.617779:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787863100.617935:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863100.617951:0:25153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931974 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.617961:0:25153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931974 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787863100.619513:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787863100.620934:0:25153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787863100.621286:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787863100.621336:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787863100.621371:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787863100.621423:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787863100.621464:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787863100.621502:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787863100.621552:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787863100.621592:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787863100.621641:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787863100.622036:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787863100.622076:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787863100.622188:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863100.622456:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.622556:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787863100.622631:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528640 00000100:00100000:3.0:1787863100.622638:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528640 00000100:00100000:2.0:1787863100.622794:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787863100.622806:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863100.623339:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528640:12345-0@lo:501:mount.lustre.0 Request processed in 535us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.623348:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787863100.623600:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787863100.623651:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787863100.624158:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.624464:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.625940:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528768 00000100:00100000:2.0:1787863100.625957:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528768 00000100:00100000:2.0:1787863100.626036:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787863100.626067:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787863100.627171:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528768:12345-0@lo:503:mount.lustre.0 Request processed in 1100us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.627184:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787863100.627953:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528768:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787863100.629543:0:25153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787863100.629648:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787863100.629824:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.630165:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787863100.630605:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526528896 00000100:00100000:0.0:1787863100.630613:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526528896 00000100:00100000:0.0:1787863100.630791:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787863100.630803:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787863100.631188:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526528896:12345-0@lo:502:mount.lustre.0 Request processed in 387us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863100.631198:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787863100.632996:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526528896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787863100.633337:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787863100.633529:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787863100.633569:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787863100.633622:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787863100.633659:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787863100.633772:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787863100.633824:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787863100.633861:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787863100.633912:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1787863100.633956:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787863100.634036:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.639994:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.640779:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529024 00000100:00100000:2.0:1787863100.640797:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529024 00000100:00100000:2.0:1787863100.641579:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787863100.641593:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526529024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.642009:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526529024:12345-0@lo:502:mount.lustre.0 Request processed in 418us (7973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.642029:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787863100.642398:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787863100.642601:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787863100.642621:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787863100.646037:0:25155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787863100.646131:0:25155:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787863100.646141:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863100.646144:0:25155:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787863100.646152:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787863100.646250:0:25155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a653aa29a48) 00000020:00000080:1.0:1787863100.646281:0:25155:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787863100.646290:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787863100.646377:0:25155:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a653d6d1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787863100.646386:0:25155:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787863100.646395:0:25155:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c5536ccf8931982 00010000:00010000:1.0:1787863100.652031:0:25155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787863100.652716:0:25155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:1.0:1787863100.655444:0:25155:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:1.0:1787863100.657282:0:25155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787863100.657295:0:25155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863100.657301:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863100.657303:0:25155:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787863100.657307:0:25155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863100.657311:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863100.657313:0:25155:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787863100.657316:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787863100.657318:0:25155:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787863100.657320:0:25155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863100.657323:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863100.657324:0:25155:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787863100.657326:0:25155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787863100.657328:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863100.657330:0:25155:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787863100.657333:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787863100.657370:0:25155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787863100.657373:0:25155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787863100.657375:0:25155:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787863100.657385:0:25155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1787863100.657527:0:25153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787863100.657557:0:25153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787863100.657627:0:25153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931974 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.657651:0:25153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6401b79800/0x9c5536ccf893196d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931974 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787863100.657659:0:25153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a653d6d1800 from 1 10000000:01000000:3.0:1787863100.657662:0:25153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787863100.657718:0:25153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.657726:0:25153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.657736:0:25153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863100.657761:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787863100.657834:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863100.659496:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506703780 going to sleep for 11 seconds 00000100:00100000:1.0:1787863100.659616:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529152 00000100:00100000:1.0:1787863100.659627:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529152 00000100:00100000:1.0:1787863100.659697:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787863100.659709:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:25153:x1874709526529152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787863100.659728:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863100.659748:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931989 expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.659776:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.659789:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.659799:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78600, rc 0) 00000100:00100000:1.0:1787863100.659873:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529152:12345-0@lo:101:mount.lustre.0 Request processed in 167us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863100.659881:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787863100.660072:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787863100.660093:0:25153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.660104:0:25153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787863100.660838:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1787863100.665585:0:25153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787863100.665916:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787863100.665963:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787863100.666029:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787863100.666099:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787863100.666136:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787863100.666201:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787863100.666253:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787863100.666290:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787863100.666360:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787863100.666369:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1787863100.666464:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787863100.666534:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863100.666585:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506703780 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.669079:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529280 00000100:00100000:2.0:1787863100.669101:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529280 00000100:00100000:2.0:1787863100.669189:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787863100.669201:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863100.669551:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529280:12345-0@lo:501:mount.lustre.0 Request processed in 351us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.669559:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787863100.670080:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787863100.670143:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787863100.670223:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863100.670261:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a652e18a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.670818:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529408 00000100:00100000:2.0:1787863100.670830:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529408 00000100:00100000:2.0:1787863100.670890:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787863100.670900:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65407a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787863100.671911:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65407a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529408:12345-0@lo:503:mount.lustre.0 Request processed in 1009us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.671923:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787863100.672381:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529408:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787863100.674156:0:25153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787863100.674349:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787863100.674457:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.674552:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.674598:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529536 00000100:00100000:2.0:1787863100.674606:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529536 00000100:00100000:2.0:1787863100.674659:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787863100.674670:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65407a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.675276:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65407a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529536:12345-0@lo:502:mount.lustre.0 Request processed in 604us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.675285:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787863100.675365:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787863100.675629:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787863100.675773:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787863100.675828:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787863100.675878:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787863100.675912:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787863100.676277:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787863100.676320:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787863100.676353:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1787863100.676398:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787863100.676468:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.676569:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.676607:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529664 00000100:00100000:2.0:1787863100.676614:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529664 00000100:00100000:2.0:1787863100.676666:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787863100.676675:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.677338:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529664:12345-0@lo:502:mount.lustre.0 Request processed in 662us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.677349:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787863100.677497:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787863100.677632:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787863100.677646:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787863100.678935:0:25159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863100.678948:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863100.678951:0:25159:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787863100.678958:0:25159:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a653d6d1800 00000020:00000080:3.0:1787863100.678960:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787863100.678968:0:25159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863100.678971:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863100.678972:0:25159:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787863100.678974:0:25159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863100.678977:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863100.678978:0:25159:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787863100.678981:0:25159:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a653d6d1800 00000020:00000080:3.0:1787863100.678983:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787863100.679235:0:25159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863100.679239:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863100.679241:0:25159:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787863100.679243:0:25159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787863100.679246:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863100.679247:0:25159:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787863100.679251:0:25159:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a653d6d1800 00000020:00000080:3.0:1787863100.679253:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787863100.679302:0:25159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787863100.679305:0:25159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787863100.679307:0:25159:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787863100.679310:0:25159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1787863100.679502:0:25153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787863100.679526:0:25153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787863100.679584:0:25153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.679597:0:25153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787863100.679650:0:25153:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787863100.679654:0:25153:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a653d6d1800 10000000:01000000:2.0:1787863100.679657:0:25153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a653d6d1800 10000000:01000000:2.0:1787863100.679662:0:25153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787863100.679667:0:25153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a653d6d1800 from 1 10000000:01000000:2.0:1787863100.679670:0:25153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787863100.679785:0:25153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.679794:0:25153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.679806:0:25153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863100.679832:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787863100.679905:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.679991:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787863100.680495:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529792 00000100:00100000:3.0:1787863100.680503:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529792 00000100:00100000:3.0:1787863100.680596:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787863100.680606:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526529792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787863100.680620:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863100.680636:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf893199e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931997 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.680659:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf893199e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931997 expref: 19 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.680672:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf893199e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931997 expref: 19 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863100.680699:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd400, rc 0) 00000100:00100000:3.0:1787863100.680752:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526529792:12345-0@lo:101:mount.lustre.0 Request processed in 147us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863100.680758:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787863100.680893:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787863100.680908:0:25153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893199e expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.680918:0:25153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf893199e expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787863100.681809:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1787863100.683912:0:25153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787863100.686329:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787863100.686428:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787863100.686469:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787863100.686520:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787863100.686575:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787863100.686622:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787863100.686654:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787863100.686699:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787863100.686749:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787863100.686821:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787863100.686856:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787863100.686911:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787863100.686949:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787863100.686985:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787863100.687038:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787863100.687099:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787863100.687132:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787863100.693406:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787863100.693518:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787863100.693553:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787863100.693602:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787863100.693637:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787863100.693667:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787863100.693750:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787863100.693786:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1787863100.693837:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1787863100.693886:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1787863100.693920:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1787863100.693954:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1787863100.694001:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1787863100.694033:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1787863100.694089:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1787863100.694124:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1787863100.694314:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1787863100.694354:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1787863100.694404:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1787863100.694439:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1787863100.694473:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1787863100.694520:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1787863100.694824:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1787863100.694936:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1787863100.694946:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1787863100.695090:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863100.697010:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.697092:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526529920 00000100:00100000:2.0:1787863100.697100:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526529920 00000100:00100000:2.0:1787863100.697150:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787863100.697159:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526529920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863100.697546:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526529920:12345-0@lo:501:mount.lustre.0 Request processed in 387us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.697555:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787863100.697619:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.697646:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526529920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787863100.699366:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526530048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787863100.699447:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.699499:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787863100.699862:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530048 00000100:00100000:3.0:1787863100.699870:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530048 00000100:00100000:3.0:1787863100.699915:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787863100.699925:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526530048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787863100.701435:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526530048:12345-0@lo:503:mount.lustre.0 Request processed in 1505us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863100.701450:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787863100.704911:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526530048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787863100.710820:0:25153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787863100.710935:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526530176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.711031:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.711106:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530176 00000100:00100000:2.0:1787863100.711113:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530176 00000100:00100000:2.0:1787863100.714731:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787863100.714768:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526530176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.715209:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526530176:12345-0@lo:502:mount.lustre.0 Request processed in 454us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.720179:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787863100.720284:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.720319:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526530176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787863100.720646:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787863100.721278:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787863100.721322:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787863100.721380:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787863100.721419:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787863100.721473:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787863100.721512:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787863100.721549:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787863100.721601:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787863100.721633:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787863100.722804:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787863100.722924:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787863100.722963:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787863100.723020:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787863100.723618:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787863100.723663:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787863100.724568:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787863100.724657:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787863100.725477:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787863100.725530:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787863100.725599:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787863100.725639:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787863100.725674:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787863100.726331:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787863100.726376:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1787863100.726412:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1787863100.726463:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1787863100.726529:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1787863100.726561:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1787863100.726640:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1787863100.726674:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1787863100.728976:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1787863100.729037:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1787863100.729996:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1787863100.730055:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1787863100.730111:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1787863100.730151:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1787863100.732254:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1787863100.732358:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1787863100.732397:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1787863100.732456:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526530304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.732557:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.732615:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787863100.733602:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530304 00000100:00100000:2.0:1787863100.733611:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530304 00000100:00100000:2.0:1787863100.733673:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787863100.733765:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526530304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787863100.734383:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526530304:12345-0@lo:502:mount.lustre.0 Request processed in 699us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.734393:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787863100.734594:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526530304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787863100.734813:0:25153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1787863100.734834:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787863100.739822:0:25164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787863100.739840:0:25164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a651c9d3490) 00000020:00000080:0.0:1787863100.739869:0:25164:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787863100.740277:0:25164:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a653d6d1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787863100.740282:0:25164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a653d6d1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787863100.740285:0:25164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a653d6d1800 3 00010000:00080000:0.0:1787863100.740320:0:25164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a650ac35800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.160@tcp at head 00010000:00010000:0.0:1787863100.744270:0:25164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787863100.744552:0:25164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787863100.744593:0:25164:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787863100.744614:0:25164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c5536ccf89319ac 00000100:00080000:0.0:1787863100.744627:0:25164:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787863100.744633:0:25164:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a650ac35800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787863100.744699:0:25164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651fc62940 x1874709526530432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787863100.744737:0:25164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787863100.745008:0:25164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00080000:3.0:1787863100.745655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787863100.745661:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787863100.745664:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787863100.745670:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 823 00000100:00080000:3.0:1787863100.745675:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787863100.745696:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6527d3a000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863100.745717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3d680 x1874709526530688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787863100.745765:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787863100.745783:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526530944:0@lo:400:kworker.0 00000100:00100000:3.0:1787863100.745870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.746020:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526530432:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787863100.746100:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.746134:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526530688:0@lo:8:kworker.0 00000100:00100000:2.0:1787863100.746176:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.746211:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530944 00000100:00100000:2.0:1787863100.746217:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530944 00000100:00100000:2.0:1787863100.746268:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530432 00000100:00100000:2.0:1787863100.746272:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530432 00000100:00100000:2.0:1787863100.746286:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787863100.746295:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526530944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863100.746348:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526530944:12345-0@lo:400:kworker.0 Request processed in 54us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.746356:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787863100.746376:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787863100.746380:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526530432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787863100.746404:0:23752:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 826 last 0 00000020:00000080:2.0:1787863100.746441:0:23752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c5536ccf89319b3 00000004:00100000:2.0:1787863100.746458:0:23752:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787863100.746493:0:23752:0:(import.c:65:import_set_state_nolock()) ffff9a6537ecd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863100.746551:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874709526530432:12345-0@lo:38:llog_process_th.0 Request processed in 169us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863100.746559:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787863100.746605:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401b3f0c0 x1874709526530944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863100.746625:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526530944:0@lo:400:kworker.0 00010000:00080000:2.0:1787863100.746657:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651fc62940 x1874709526530432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787863110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863100.746666:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787863100.746673:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1787863100.746720:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787863100.746726:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787863100.746728:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a650ac35800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787863100.746735:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526530432:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787863100.746764:0:25153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787863100.746804:0:25153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787863100.746823:0:25153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893199e expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863100.746835:0:25153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6510a17000/0x9c5536ccf8931997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf893199e expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787863100.746894:0:25153:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787863100.746897:0:25153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787863100.746898:0:25153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863100.746899:0:25153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863100.746901:0:25153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863100.746906:0:25153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863100.746908:0:25153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787863100.746910:0:25153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863100.746911:0:25153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787863100.746915:0:25153:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787863100.746918:0:25153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787863100.746919:0:25153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787863100.746920:0:25153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863100.746921:0:25153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863100.746921:0:25153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863100.746922:0:25153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863100.746923:0:25153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787863100.746924:0:25153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863100.746925:0:25153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787863100.746943:0:25153:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787863100.746956:0:25153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526531072:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787863100.747000:0:25153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863100.747031:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531072 00000100:00100000:2.0:1787863100.747036:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531072 00000100:00100000:2.0:1787863100.747093:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787863100.747099:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:25153:x1874709526531072:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787863100.747137:0:23747:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787863100.747153:0:23747:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787863100.747662:0:25153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651149a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787863100.747936:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526530560:0@lo:400:kworker.0 00000100:00100000:0.0:1787863100.747991:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863100.748029:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787863100.748036:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526530816:0@lo:400:kworker.0 00000100:00100000:0.0:1787863100.748078:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863100.748112:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530688 00000100:00100000:0.0:1787863100.748119:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530688 00000100:00100000:0.0:1787863100.748141:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530560 00000100:00100000:0.0:1787863100.748144:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530560 00000100:00100000:0.0:1787863100.748200:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787863100.748208:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526530560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863100.748259:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526530560:12345-0@lo:400:kworker.0 Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863100.748268:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787863100.748284:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863100.748289:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3280:x1874709526530688:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787863100.748338:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3280:x1874709526530688:12345-0@lo:8:kworker.0 Request processed in 47us (2173us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787863100.748344:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863100.748416:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787863100.748423:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787863100.748427:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787863100.748431:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526530688:0@lo:8:kworker.0 00000100:00100000:0.0:1787863100.748722:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526530816 00000100:00100000:0.0:1787863100.748729:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526530816 00000100:00100000:0.0:1787863100.748761:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787863100.748769:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526530816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863100.748807:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526530816:12345-0@lo:400:kworker.0 Request processed in 39us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863100.748812:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787863100.748845:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401b3e940 x1874709526530816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863100.748855:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526530816:0@lo:400:kworker.0 00000100:00100000:0.0:1787863100.748866:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526530560:0@lo:400:kworker.0 00000100:00080000:3.0:1787863100.750320:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787863100.750333:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1787863100.797303:0:23747:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787863100.797474:0:23747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787863100.799331:0:23768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787863100.799342:0:23768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787863100.799369:0:23768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.799500:0:23768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 19 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.799509:0:23768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.799554:0:23768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 19 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.799570:0:23768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 19 pid: 23746 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863100.799604:0:23768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23768:1874709526531200:0@lo:104: 00000100:00100000:1.0:1787863100.799677:0:23768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.799841:0:23768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787863100.800157:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531200 00000100:00100000:0.0:1787863100.800165:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531200 00000100:00100000:0.0:1787863100.800213:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787863100.800223:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:23768:x1874709526531200:12345-0@lo:104: 00010000:00010000:0.0:1787863100.800237:0:23736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863100.800293:0:23736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787863100.800299:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:23768:x1874709526531200:12345-0@lo:104: Request processed in 78us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863100.800306:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787863100.800371:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863100.800450:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800460:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17e00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863100.800465:0:23741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800473:0:23741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863100.800480:0:23741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863100.800485:0:23741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787863100.800566:0:23741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800572:0:23741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787863100.800595:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800602:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6510a17e00/0x9c5536ccf8931871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931878 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800617:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863100.800628:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863100.800630:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863100.800639:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787863100.800652:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526531328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863100.800707:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863100.800743:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531328 00000100:00100000:1.0:1787863100.800747:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531328 00010000:00010000:1.0:1787863100.800768:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 20 pid: 23746 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863100.800793:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787863100.800799:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+20:3283:x1874709526531328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863100.800810:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863100.800815:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 20 pid: 23746 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800827:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 20 pid: 23746 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800845:0:23737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.800853:0:23737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787863100.800865:0:23737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001816010s 00010000:00010000:1.0:1787863100.800997:0:23737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801008:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801025:0:23737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801030:0:23737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801035:0:23737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863100.801038:0:23737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801072:0:23737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801083:0:23737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801094:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863100.801127:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+20:3283:x1874709526531328:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863100.801134:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787863100.801175:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526531328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863100.801206:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8931878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8931871 expref: 19 pid: 23746 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863100.801218:0:23768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23768:1874709526531200:0@lo:104: 00010000:00010000:1.0:1787863100.801231:0:23768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801250:0:23768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801256:0:23768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863100.801263:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b78000/0x9c5536ccf89319ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863100.812870:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:25153:x1874709526531072:12345-0@lo:253:mount.lustre.0 Request processed in 65759us (65857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863100.813010:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787863100.813148:0:25153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38779eb7-76b5-435e-9dc5-da8e02f86cb2:25153:1874709526531072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787863100.813166:0:25153:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787863100.813169:0:25153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787863100.813171:0:25153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787863100.813172:0:25153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787863100.813174:0:25153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787863100.813174:0:25153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787863100.813176:0:25153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787863100.813177:0:25153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787863100.813179:0:25153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787863100.813180:0:25153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787863100.813214:0:25153:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787863100.825149:0:25153:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787863100.825341:0:25153:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787863100.825533:0:25153:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787863100.825713:0:25153:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787863100.825940:0:25153:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1787863100.826130:0:25153:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:3.0:1787863100.832319:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787863100.833464:0:25153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787863100.931897:0:25153:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787863100.931909:0:25153:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787863100.931954:0:25153:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787863100.932024:0:25153:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787863100.932514:0:25153:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787863100.932546:0:25153:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787863101.855878:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787863102.428132:0:23749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787863102.428145:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6527360000 from 11 10000000:01000000:0.0:1787863102.428153:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787863102.428234:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.428249:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.428263:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863102.428293:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526531456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787863102.428370:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863102.428422:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787863102.428459:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531456 00000100:00100000:0.0:1787863102.428464:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531456 00000100:00100000:0.0:1787863102.428508:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787863102.428515:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526531456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787863102.428529:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863102.428543:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534636800/0x9c5536ccf89319c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89319c1 expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.428566:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636800/0x9c5536ccf89319c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89319c1 expref: 19 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.428577:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534636800/0x9c5536ccf89319c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89319c1 expref: 19 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.428587:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636800, rc 0) 00000100:00100000:0.0:1787863102.428630:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526531456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863102.428637:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787863102.428701:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526531456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787863102.428715:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89319c8 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.428723:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89319c8 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863102.428773:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526531584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787863102.428806:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863102.428820:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787863102.428862:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531584 00000100:00100000:0.0:1787863102.428866:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531584 00000100:00100000:0.0:1787863102.428890:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787863102.428896:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526531584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787863102.428913:0:23747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787863102.428932:0:23747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787863102.428935:0:23747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787863102.429015:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526531584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863102.429023:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787863102.429096:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526531584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787863102.429166:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787863102.429176:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89319c8 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863102.429185:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534636600/0x9c5536ccf89319c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89319c8 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863102.621517:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526531712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787863102.621609:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863102.621681:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531712 00000100:00100000:3.0:1787863102.621693:0:24439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531712 00000100:00100000:3.0:1787863102.621787:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787863102.621903:0:24439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526531712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787863102.621947:0:24439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787863102.622005:0:24439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526531712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863102.622013:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787863102.622243:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526531712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787863102.622304:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787863102.883731:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863103.901319:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863104.925957:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863105.949298:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787863106.213845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787863106.213855:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787863106.213861:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787863106.213878:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6527d3a000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787863106.213911:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401b3d2c0 x1874709526532096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787863106.214010:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526531840:0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214138:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863106.214202:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526532480:0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214241:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863106.214274:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787863106.214279:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526532352:0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214302:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863106.214332:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526532224:0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214356:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863106.214374:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787863106.214379:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526531968:0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863106.214535:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526532096:0@lo:8:kworker.0 00000100:00100000:3.0:1787863106.214567:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863106.214627:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531840 00000100:00100000:3.0:1787863106.214644:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531840 00000100:00100000:3.0:1787863106.214696:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787863106.214705:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3282:x1874709526531840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214756:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3282:x1874709526531840:12345-0@lo:400:kworker.0 Request processed in 52us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863106.214763:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787863106.214804:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532480 00000100:00100000:3.0:1787863106.214808:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532480 00000100:00100000:3.0:1787863106.214839:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532352 00000100:00100000:3.0:1787863106.214841:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532352 00000100:00100000:3.0:1787863106.214851:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532224 00000100:00100000:3.0:1787863106.214853:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532224 00000100:00100000:3.0:1787863106.214863:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787863106.214868:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526532480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214896:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526532480:12345-0@lo:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863106.214903:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787863106.214912:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787863106.214917:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214935:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526532352:12345-0@lo:400:kworker.0 Request processed in 19us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863106.214940:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787863106.214948:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787863106.214962:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.214994:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526532224:12345-0@lo:400:kworker.0 Request processed in 32us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863106.215000:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787863106.215026:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526531968 00000100:00100000:3.0:1787863106.215029:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526531968 00000100:00100000:3.0:1787863106.215076:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532096 00000100:00100000:3.0:1787863106.215079:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532096 00000100:00100000:3.0:1787863106.215089:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787863106.215095:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863106.215124:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526531968:12345-0@lo:400:kworker.0 Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863106.215130:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787863106.215140:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787863106.215143:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3280:x1874709526532096:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787863106.215172:0:24436:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 831 last 0 00000020:00000080:3.0:1787863106.215206:0:24436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf89319cf 00002000:00100000:3.0:1787863106.215223:0:24436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a6537e6e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787863106.215228:0:24436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787863106.215231:0:24436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1787863106.219565:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3e580 x1874709526532352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863106.219591:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526532352:0@lo:400:kworker.0 00000100:00100000:2.0:1787863106.219608:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526531840:0@lo:400:kworker.0 00010000:00080000:2.0:1787863106.219621:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3f840 x1874709526532480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863106.219641:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526532480:0@lo:400:kworker.0 00000100:00100000:2.0:1787863106.220103:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526531968:0@lo:400:kworker.0 00010000:00080000:2.0:1787863106.220121:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3da40 x1874709526532224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787863106.220131:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526532224:0@lo:400:kworker.0 00000100:00080000:2.0:1787863106.220160:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787863106.220169:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1787863106.222344:0:24436:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787863106.222398:0:24436:0:(import.c:65:import_set_state_nolock()) ffff9a6537e68000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787863106.222528:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874709526532096:12345-0@lo:8:kworker.0 Request processed in 7380us (7958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863106.222542:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787863106.222614:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3d2c0 x1874709526532096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787863131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787863106.228984:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787863106.229005:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787863106.229014:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787863106.229019:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6527d3a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787863106.229061:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787863106.229074:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526532096:0@lo:8:kworker.0 00000004:00080000:3.0:1787863106.229147:0:23776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787863106.229542:0:23777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:1.0:1787863106.229572:0:23777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23777:1874709526532736:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787863106.229681:0:23777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863106.229730:0:23777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787863106.229750:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526532608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787863106.229783:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863106.229834:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532736 00000100:00100000:1.0:1787863106.229844:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532736 00000100:00100000:1.0:1787863106.229919:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787863106.229929:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23777:x1874709526532736:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787863106.230848:0:23776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 831994801998ns, next at 0ns, rc = 0 00000100:00080000:0.0:1787863106.237834:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787863106.237878:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532608 00000100:00100000:0.0:1787863106.237893:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532608 00000100:00100000:0.0:1787863106.237988:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787863106.238002:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402aded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874709526532608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787863106.238086:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863106.238231:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402aded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874709526532608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (8445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863106.238240:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787863106.238358:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6516828f00 x1874709526532608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787863122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863106.238397:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526532608:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1787863106.250143:0:24437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787863106.250161:0:24437:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787863106.250178:0:24437:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:1.0:1787863106.280162:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.280184:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280210:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.280216:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.280225:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280247:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280260:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280269:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280291:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.280306:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.280312:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280320:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.280325:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280795:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280822:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280831:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9cc6256/0x9c5536ccf89319d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.280857:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.280860:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.280862:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.285411:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.285501:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285527:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.285534:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.285543:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285563:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285575:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285594:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285625:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.285658:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.285665:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285674:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.285678:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285688:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285708:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285717:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000065d01d9/0x9c5536ccf89319dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.285739:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.285741:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.285743:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.288687:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.288724:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288750:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.288755:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.288764:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288782:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288794:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288803:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288824:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.288839:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.288847:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288856:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.288862:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288872:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288898:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288906:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052f8609/0x9c5536ccf89319e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.288924:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.288927:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.288928:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.299987:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.300004:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300026:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.300032:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.300040:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300076:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300088:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300097:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300139:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.300162:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.300170:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300179:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.300184:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300195:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300215:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300222:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf89319eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300244:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.300246:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.300248:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.300734:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.300741:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300752:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.300760:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.300765:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300775:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300784:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300793:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300809:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.300819:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.300824:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300831:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.300835:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300842:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300852:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300869:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059ae6559/0x9c5536ccf89319f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.300883:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.300884:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.300886:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.301302:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.301309:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301318:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.301321:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.301326:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301336:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301344:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301351:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301366:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.301374:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.301384:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301391:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78e00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.301395:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301402:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301413:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301421:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f564f576/0x9c5536ccf89319f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301435:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.301436:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.301438:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.301829:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.301835:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301844:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.301847:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.301851:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301871:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301881:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301888:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301901:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.301907:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.301911:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301916:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79e00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.301920:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301927:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301938:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301945:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ae8c81/0x9c5536ccf8931a00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.301962:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.301964:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.301966:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.302351:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.302357:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302366:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.302369:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.302374:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302383:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302392:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302399:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302414:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.302421:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.302424:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302440:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.302444:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302453:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302464:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302470:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553b82f7/0x9c5536ccf8931a07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.302483:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.302485:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.302486:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.310615:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.310647:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310673:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.310680:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.310687:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310704:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310726:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310733:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310758:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.310778:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.310787:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310796:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.310803:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310813:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310836:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310845:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8931a0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.310875:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.310882:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.310885:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.315832:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.315853:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.315879:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.315885:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.315893:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.315911:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.315926:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.315935:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.315960:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.315978:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.315986:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.315995:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204e400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.316001:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.316028:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.316071:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.316080:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028617c36/0x9c5536ccf8931a15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.316108:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.316110:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.316112:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787863106.320527:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787863106.321295:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.321309:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.323908:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.323924:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.323938:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.323968:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.323982:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.324002:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.324101:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787863106.324953:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.324964:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.324976:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.324980:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.324986:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.324997:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.325007:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.325015:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332461:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787863106.332485:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332504:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787863106.332510:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332523:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332561:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332570:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ac0e74/0x9c5536ccf8931a1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332603:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787863106.332616:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332624:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787863106.332635:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332644:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332656:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863106.332665:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863106.332667:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863106.332669:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.335517:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787863106.335541:0:24437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.335616:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.336641:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.336657:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336678:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.336684:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.336691:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336708:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336721:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336729:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336761:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.336780:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.336789:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336798:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204e800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.336810:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336821:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336843:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336852:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb7619d2/0x9c5536ccf8931a2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.336876:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.336878:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.336880:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.337394:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.337403:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337412:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.337416:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.337421:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337431:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337440:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337455:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337474:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.337486:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.337490:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337498:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.337501:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337510:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337523:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337531:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.337548:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.337550:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.337551:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.338017:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.338031:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338065:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.338070:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.338075:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338085:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338095:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338102:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338118:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.338129:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.338134:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338142:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.338146:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338154:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338176:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338184:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.338201:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.338203:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.338205:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.338613:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.338620:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349509:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.349521:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.349532:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349559:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349573:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349582:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349660:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.349682:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.349690:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349699:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.349704:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349715:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349740:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349749:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.349778:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.349780:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.349782:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.353091:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.353112:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353136:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.353149:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.353160:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353180:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353193:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353202:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353229:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.353250:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.353257:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353266:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.353271:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353282:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353302:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.353322:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.356539:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.356543:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.356545:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863106.358947:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.358966:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.358997:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.359002:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.359011:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.359030:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.359070:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.359080:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.359107:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.361692:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.361709:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.361727:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.361734:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.361747:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.361779:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.361789:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ffe20d8/0x9c5536ccf8931a4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.361813:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.361815:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.361817:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863106.364956:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.365567:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.365603:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.365609:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.365639:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.365660:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.365674:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.365682:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.365845:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787863106.366771:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.366784:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.366798:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.366801:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.366809:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.366822:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.366832:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.366854:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374675:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787863106.374697:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374715:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.374722:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374734:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374764:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374774:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009861c672/0x9c5536ccf8931a54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374801:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.374806:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374813:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.374816:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374825:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374851:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.374860:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.374863:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.374865:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863106.374962:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787863106.374972:0:24437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.375699:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863106.378698:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.378732:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.378763:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.378770:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.378781:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.378806:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.378824:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.378834:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.378885:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.379727:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.379741:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.379754:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.379760:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.379771:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.379797:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.379805:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f87d8b0/0x9c5536ccf8931a62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.379833:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.379835:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.379846:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863106.380912:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.380927:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.380945:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.380949:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.380957:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.380969:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.380993:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.381003:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.381032:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.381783:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.381795:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.381804:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.381809:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.381819:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.381837:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.381845:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931a69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.381868:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.381870:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.381871:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863106.382028:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.382035:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.382081:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.382093:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.382099:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.382110:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.382118:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.382126:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.382146:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.382715:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.382724:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.382733:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.382737:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.382757:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.382770:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.382778:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f9ed12c/0x9c5536ccf8931a70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.382796:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.382797:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.382799:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.386304:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.386677:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386708:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.386714:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.386722:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386741:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386753:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386780:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386809:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.386832:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.386840:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386849:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.386856:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386868:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386894:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386903:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad52d2f/0x9c5536ccf8931a77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.386924:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.386926:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.386928:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.389671:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.389703:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389727:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.389733:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.389741:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389758:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389770:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389778:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389808:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.389831:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.389838:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389846:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.389851:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389860:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389890:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389898:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf8931a7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.389922:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.389924:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.389926:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.391332:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.391350:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.391370:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.391376:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.391385:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.391400:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.391413:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.391423:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.394102:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.394144:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.394156:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.394173:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.394179:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.394191:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.394217:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.394225:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf8931a85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.394251:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.394253:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.394255:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787863106.399223:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787863106.399250:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399277:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=832s v=(0 0) 00010000:00010000:1.0:1787863106.399290:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787863106.399299:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399319:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399671:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399680:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399706:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787863106.399725:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.399733:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399742:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.399748:0:23740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399759:0:23740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399782:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399805:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8931a8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.399836:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.399838:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.399840:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787863106.401703:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.401721:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.401743:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.401750:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.401758:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.401773:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.401785:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.401806:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.401830:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787863106.402303:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.402311:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402320:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.402324:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.402328:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402339:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402347:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402355:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402371:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787863106.402871:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.402878:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402894:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.402897:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.402902:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402912:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402921:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402929:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.402938:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787863106.403417:0:24437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787863106.403424:0:24437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.403435:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=832s v=(0 0) 00010000:00010000:0.0:1787863106.403438:0:24437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787863106.403442:0:24437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.403452:0:24437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.403472:0:24437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.403479:0:24437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863106.403488:0:24437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:0.0:1787863106.403675:0:24437:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:0.0:1787863106.403815:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23777:x1874709526532736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 173882us (174129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863106.403828:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787863106.404204:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787863106.404215:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404226:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.404232:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404243:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404264:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404272:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f767345b/0x9c5536ccf8931a93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404294:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787863106.404298:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404316:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.404319:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404341:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404353:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404359:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006071534e/0x9c5536ccf8931a9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404376:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787863106.404379:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404386:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.404389:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404396:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404406:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404421:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3281fbb/0x9c5536ccf8931aa1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404434:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863106.404437:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404444:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863106.404457:0:23741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404466:0:23741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404477:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404485:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005150f741/0x9c5536ccf8931aa8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863106.404500:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.404501:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.404503:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863106.404512:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863106.404571:0:23777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23777:1874709526532736:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787863106.404603:0:23777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:1.0:1787863106.404689:0:23777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402ade940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23777:1874709526532864:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787863106.404747:0:23777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863106.404815:0:23777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787863106.405029:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532864 00000100:00100000:2.0:1787863106.405038:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532864 00000100:00100000:2.0:1787863106.412428:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787863106.412576:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23777:x1874709526532864:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787863106.412670:0:24436:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1787863106.435699:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:23777:x1874709526532864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23237us (30935us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787863106.435728:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787863106.439094:0:23777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402ade940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23777:1874709526532864:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787863106.439124:0:23777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:2.0:1787863106.979697:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863107.741278:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526532992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787863107.741361:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863107.741499:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526532992 00000100:00100000:2.0:1787863107.741507:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526532992 00000100:00100000:2.0:1787863107.741567:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787863107.741578:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526532992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787863107.741772:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787863107.741907:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526532992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 329us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863107.741916:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787863107.741939:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526532992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787863107.999118:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787863108.510366:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787863109.028362:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787863109.810479:0:25509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787863110.044271:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863111.069939:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863111.327912:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787863111.327939:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526533120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787863111.328135:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863111.328620:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526533632:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.328677:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863111.328711:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787863111.328718:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526533248:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.328749:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863111.328793:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526533760:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.328821:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863111.328853:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533120 00000100:00100000:0.0:1787863111.328861:0:24439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533120 00000100:00100000:0.0:1787863111.329069:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863111.329080:0:24439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526533120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787863111.329132:0:24439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863111.329178:0:24439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526533120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863111.329185:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863111.329233:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526533376:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863111.329281:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787863111.329286:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526533504:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329308:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863111.329342:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533248 00000100:00100000:0.0:1787863111.329346:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533248 00000100:00100000:0.0:1787863111.329377:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787863111.329383:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3281:x1874709526533248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329419:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3281:x1874709526533248:12345-0@lo:400:kworker.0 Request processed in 35us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863111.329425:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787863111.329452:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533632 00000100:00100000:0.0:1787863111.329456:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533632 00000100:00100000:0.0:1787863111.329478:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533760 00000100:00100000:0.0:1787863111.329480:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533760 00000100:00100000:0.0:1787863111.329492:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533504 00000100:00100000:0.0:1787863111.329499:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533504 00000100:00100000:0.0:1787863111.329516:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787863111.329523:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526533632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329557:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526533632:12345-0@lo:400:kworker.0 Request processed in 34us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863111.329563:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787863111.329573:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787863111.329578:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526533760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329618:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526533760:12345-0@lo:400:kworker.0 Request processed in 40us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863111.329624:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787863111.329635:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787863111.329640:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526533504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329669:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526533504:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863111.329675:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787863111.329692:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787863111.329697:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787863111.329711:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533376 00000100:00100000:0.0:1787863111.329714:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533376 00000100:00100000:0.0:1787863111.329744:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787863111.329751:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526533376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.329780:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526533376:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863111.329786:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787863111.330206:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787863111.330243:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3da40 x1874709526533504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863111.330267:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526533504:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.330283:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526533376:0@lo:400:kworker.0 00000100:00100000:0.0:1787863111.330321:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526533248:0@lo:400:kworker.0 00010000:00080000:0.0:1787863111.330334:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3f840 x1874709526533760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863111.330343:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526533760:0@lo:400:kworker.0 00010000:00080000:0.0:1787863111.330354:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3cf00 x1874709526533632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787863127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787863111.330363:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526533632:0@lo:400:kworker.0 00000100:00100000:2.0:1787863111.335920:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526533120:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787863111.468334:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787863111.468355:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787863112.093315:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863112.873811:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526533888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787863112.873905:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863112.876995:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526533888 00000100:00100000:1.0:1787863112.877010:0:24439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526533888 00000100:00100000:1.0:1787863112.877688:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787863112.877703:0:24439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526533888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787863112.877748:0:24439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787863112.877865:0:24439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526533888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863112.877874:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787863112.877960:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526533888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787863112.913948:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863112.914117:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086208 00000100:00100000:2.0:1787863112.914128:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086208 00000100:00100000:2.0:1787863112.914180:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:2.0:1787863112.914189:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1874709517086208:12345-192.168.202.60@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787863112.914223:0:23745:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from b170930b-71af-4df4-aeea-8cf989f3465f@192.168.202.60@tcp t0 exp 0000000000000000 cur 838 last 0 00000020:00000080:2.0:1787863112.914256:0:23745:0:(genops.c:1385:class_connect()) connect: client b170930b-71af-4df4-aeea-8cf989f3465f, cookie 0x9c5536ccf8931aaf 00000100:00080000:2.0:1787863112.914407:0:23745:0:(import.c:65:import_set_state_nolock()) ffff9a6537ecf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863112.914490:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+5:2345:x1874709517086208:12345-192.168.202.60@tcp:250:mount.lustre.0 Request processed in 300us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863112.914497:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:3.0:1787863112.926100:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863112.926248:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086336 00000100:00100000:0.0:1787863112.926261:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086336 00000100:00100000:0.0:1787863112.926326:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:0.0:1787863112.926337:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+5:17676:x1874709517086336:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787863112.926355:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863112.926374:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637c00/0x9c5536ccf8931ab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34cd7 expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863112.926417:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637c00/0x9c5536ccf8931ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cd7 expref: 6 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863112.926452:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637c00/0x9c5536ccf8931ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cd7 expref: 6 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863112.926461:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637c00, rc 0) 00000100:00100000:0.0:1787863112.926523:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+6:17676:x1874709517086336:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 188us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863112.926530:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:3.0:1787863112.932238:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863112.932720:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086464 00000100:00100000:0.0:1787863112.932730:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086464 00000100:00100000:0.0:1787863112.932869:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:0.0:1787863112.932880:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+6:17676:x1874709517086464:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787863112.933688:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+6:17676:x1874709517086464:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 805us (1458us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787863112.933702:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:3.0:1787863112.944208:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863112.948333:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086592 00000100:00100000:2.0:1787863112.948352:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086592 00000100:00100000:2.0:1787863112.948438:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:2.0:1787863112.948449:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+6:17676:x1874709517086592:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787863112.948468:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863112.948487:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a17600/0x9c5536ccf8931abd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34cde expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863112.948519:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a17600/0x9c5536ccf8931abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cde expref: 7 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863112.948531:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a17600/0x9c5536ccf8931abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cde expref: 7 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863112.948540:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17600, rc 0) 00000100:00100000:2.0:1787863112.948638:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+7:17676:x1874709517086592:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 190us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863112.948645:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:3.0:1787863112.952605:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863112.952725:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086720 00000100:00100000:0.0:1787863112.952738:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086720 00000100:00100000:0.0:1787863112.952809:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:0.0:1787863112.952830:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+7:17676:x1874709517086720:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787863112.953520:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+8:17676:x1874709517086720:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 698us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863112.953530:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:1.0:1787863112.958378:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863112.958529:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086848 00000100:00100000:3.0:1787863112.958539:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086848 00000100:00100000:3.0:1787863112.958606:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787863112.958617:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+8:17676:x1874709517086848:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787863112.959647:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+8:17676:x1874709517086848:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 1026us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863112.959667:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787863112.967559:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863112.968629:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517086976 00000100:00100000:2.0:1787863112.968645:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517086976 00000100:00100000:2.0:1787863112.968719:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:2.0:1787863112.968729:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+8:17694:x1874709517086976:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787863112.975360:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+8:17694:x1874709517086976:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 6614us (7795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863112.975379:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:2.0:1787863113.002550:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863113.002716:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087104 00000100:00100000:3.0:1787863113.002733:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087104 00000100:00100000:3.0:1787863113.003039:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:3.0:1787863113.003092:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+8:17694:x1874709517087104:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787863113.004545:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+8:17694:x1874709517087104:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 1448us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863113.004557:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:3.0:1787863113.013547:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863113.013800:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087232 00000100:00100000:2.0:1787863113.013836:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087232 00000100:00100000:2.0:1787863113.013909:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:2.0:1787863113.013920:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653e47b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+8:17676:x1874709517087232:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787863113.013937:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863113.013957:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a17a00/0x9c5536ccf8931ac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d08 expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863113.013985:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a17a00/0x9c5536ccf8931ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d08 expref: 9 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863113.013997:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a17a00/0x9c5536ccf8931ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d08 expref: 9 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863113.014007:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17a00, rc 0) 00000100:00100000:2.0:1787863113.014106:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653e47b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+9:17676:x1874709517087232:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 187us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863113.014126:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:1.0:1787863113.027873:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863113.028095:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087360 00000100:00100000:3.0:1787863113.028109:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087360 00000100:00100000:3.0:1787863113.028187:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:3.0:1787863113.028198:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+9:17676:x1874709517087360:12345-192.168.202.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787863113.028225:0:23747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787863113.028250:0:23747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787863113.028254:0:23747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787863113.028258:0:23747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787863113.028260:0:23747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1787863113.033507:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+9:17676:x1874709517087360:12345-192.168.202.60@tcp:256:mount.lustre.0 Request processed in 5297us (5631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.033525:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:0.0:1787863113.037858:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863113.038280:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087488 00000100:00100000:2.0:1787863113.038291:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087488 00000100:00100000:2.0:1787863113.038357:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:2.0:1787863113.038368:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+9:17676:x1874709517087488:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787863113.038387:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863113.038406:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d0f expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863113.038436:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 10 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863113.038447:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 10 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863113.038474:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16200, rc 0) 00000100:00100000:2.0:1787863113.038540:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+10:17676:x1874709517087488:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 173us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863113.038547:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:1.0:1787863113.045497:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863113.045663:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087616 00000100:00100000:0.0:1787863113.045680:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087616 00000100:00100000:0.0:1787863113.045774:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:0.0:1787863113.045786:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+10:17676:x1874709517087616:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787863113.046543:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+10:17676:x1874709517087616:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 754us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.046554:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:2.0:1787863113.050232:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863113.050765:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087744 00000100:00100000:0.0:1787863113.050780:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087744 00000100:00100000:0.0:1787863113.050866:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:0.0:1787863113.050889:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+10:17676:x1874709517087744:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787863113.052320:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+10:17676:x1874709517087744:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 1433us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.052332:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:2.0:1787863113.061390:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863113.062102:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517087872 00000100:00100000:0.0:1787863113.062193:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517087872 00000100:00100000:0.0:1787863113.062276:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:0.0:1787863113.062289:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+10:17698:x1874709517087872:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787863113.064245:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+10:17698:x1874709517087872:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 1948us (2861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.064263:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:0.0:1787863113.077149:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863113.078437:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088000 00000100:00100000:2.0:1787863113.078455:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088000 00000100:00100000:3.0:1787863113.080186:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:3.0:1787863113.085243:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+10:17698:x1874709517088000:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787863113.085723:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+10:17698:x1874709517088000:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 5517us (8590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863113.085735:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:2.0:1787863113.120542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863113.120672:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088128 00000100:00100000:0.0:1787863113.120685:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088128 00000100:00100000:0.0:1787863113.120779:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:0.0:1787863113.120809:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1874709517088128:12345-192.168.202.60@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787863113.120855:0:23753:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from dfe61ff8-722b-424a-b548-843f4f74cf11@192.168.202.60@tcp t0 exp 0000000000000000 cur 838 last 0 00000020:00000080:0.0:1787863113.120927:0:23753:0:(genops.c:1385:class_connect()) connect: client dfe61ff8-722b-424a-b548-843f4f74cf11, cookie 0x9c5536ccf8931ad2 00000004:00100000:0.0:1787863113.120963:0:23753:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1787863113.120970:0:23753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1787863113.122039:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787863113.167728:0:23753:0:(import.c:65:import_set_state_nolock()) ffff9a651fc3d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787863113.167834:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2345:x1874709517088128:12345-192.168.202.60@tcp:38:mount.lustre.0 Request processed in 47025us (47312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.167849:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:2.0:1787863113.176213:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863113.176275:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863113.176422:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088384 00000100:00100000:0.0:1787863113.176437:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088384 00000100:00100000:0.0:1787863113.176526:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088256 00000100:00100000:0.0:1787863113.176530:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088256 00000100:00100000:0.0:1787863113.176551:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1787863113.176562:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:17676:x1874709517088384:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787863113.176626:0:23754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787863113.176759:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:17676:x1874709517088384:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 198us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.176768:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1787863113.176785:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787863113.176793:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+6:0:x1874709517088256:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787863113.176808:0:23754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787863113.176836:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+6:0:x1874709517088256:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 45us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863113.176842:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00080000:1.0:1787863113.177386:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787863113.183690:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863113.183822:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088512 00000100:00100000:0.0:1787863113.183839:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088512 00000100:00100000:2.0:1787863113.184081:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:2.0:1787863113.184102:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17676:x1874709517088512:12345-192.168.202.60@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787863113.184239:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17676:x1874709517088512:12345-192.168.202.60@tcp:40:mount.lustre.0 Request processed in 145us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863113.184247:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787863113.186947:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863113.187122:0:23755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088896 00000100:00100000:2.0:1787863113.187133:0:23755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088896 00000100:00100000:2.0:1787863113.187190:0:23755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1787863113.187201:0:23755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17676:x1874709517088896:12345-192.168.202.60@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787863113.188162:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863113.188200:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863113.188419:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088640 00000100:00100000:2.0:1787863113.188428:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088640 00000100:00100000:2.0:1787863113.188467:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517088768 00000100:00100000:2.0:1787863113.188470:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517088768 00000100:00100000:2.0:1787863113.188483:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787863113.188499:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402add680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874709517088640:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787863113.188532:0:24436:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from dfe61ff8-722b-424a-b548-843f4f74cf11@192.168.202.60@tcp t0 exp 0000000000000000 cur 838 last 0 00000020:00000080:2.0:1787863113.188592:0:24436:0:(genops.c:1385:class_connect()) connect: client dfe61ff8-722b-424a-b548-843f4f74cf11, cookie 0x9c5536ccf8931ad9 00002000:00100000:2.0:1787863113.188607:0:24436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dfe61ff8-722b-424a-b548-843f4f74cf11/ffff9a64011e8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787863113.188619:0:24436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787863113.189007:0:24436:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787863113.189072:0:24436:0:(import.c:65:import_set_state_nolock()) ffff9a64011ec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863113.189158:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402add680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2345:x1874709517088640:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 659us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863113.189167:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787863113.189184:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787863113.189189:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402add2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874709517088768:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787863113.189207:0:24436:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from dfe61ff8-722b-424a-b548-843f4f74cf11@192.168.202.60@tcp t0 exp 0000000000000000 cur 838 last 0 00000020:00000080:2.0:1787863113.189229:0:24436:0:(genops.c:1385:class_connect()) connect: client dfe61ff8-722b-424a-b548-843f4f74cf11, cookie 0x9c5536ccf8931ae0 00002000:00100000:2.0:1787863113.189235:0:24436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dfe61ff8-722b-424a-b548-843f4f74cf11/ffff9a64011e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787863113.189242:0:24436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787863113.189519:0:24436:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787863113.189539:0:24436:0:(import.c:65:import_set_state_nolock()) ffff9a64011ee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863113.189579:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402add2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2345:x1874709517088768:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 389us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863113.189586:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000004:00080000:1.0:1787863113.196384:0:23755:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9099us 00000004:00200000:2.0:1787863113.223351:0:23755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787863113.223576:0:23755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17676:x1874709517088896:12345-192.168.202.60@tcp:33:mount.lustre.0 Request processed in 36361us (36625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863113.223599:0:23755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1787863113.584526:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863113.584667:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089024 00000100:00100000:3.0:1787863113.584687:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089024 00000100:00100000:3.0:1787863113.584763:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1787863113.584773:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17719:x1874709517089024:12345-192.168.202.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787863113.584794:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863113.584823:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d39 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863113.584897:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931aee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863113.584923:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863113.584940:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863113.585188:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787863113.585192:0:23752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787863113.585305:0:23752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863113.585337:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d39 expref: 8 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863113.585355:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931aee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d39 expref: 7 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863113.585364:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787863113.585367:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787863113.585371:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc400, rc 0) 00000100:00100000:3.0:1787863113.585451:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:17719:x1874709517089024:12345-192.168.202.60@tcp:101:mkdir.0 Request processed in 678us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863113.585459:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000001:00100000:0.0:1787863114.037800:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dfe61ff8-722b-424a-b548-843f4f74cf11 00010000:00010000:3.0:1787863114.141598:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863115.165750:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863116.072918:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.073076:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089152 00000100:00100000:0.0:1787863116.073086:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089152 00000100:00100000:0.0:1787863116.073166:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:0.0:1787863116.073177:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402ade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:17771:x1874709517089152:12345-192.168.202.60@tcp:41:lfs.0 00000004:00000024:0.0:1787863116.073227:0:23754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787863116.073337:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402ade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:17771:x1874709517089152:12345-192.168.202.60@tcp:41:lfs.0 Request processed in 160us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.073344:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:1.0:1787863116.073412:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787863116.080217:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863116.080338:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089280 00000100:00100000:2.0:1787863116.080348:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089280 00000100:00100000:2.0:1787863116.080437:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:2.0:1787863116.080448:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfe61ff8-722b-424a-b548-843f4f74cf11+5:17771:x1874709517089280:12345-192.168.202.60@tcp:13:lfs.0 00002000:00000024:2.0:1787863116.080489:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787863116.080594:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfe61ff8-722b-424a-b548-843f4f74cf11+5:17771:x1874709517089280:12345-192.168.202.60@tcp:13:lfs.0 Request processed in 148us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.080603:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00080000:1.0:1787863116.080804:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787863116.084228:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.084331:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089408 00000100:00100000:0.0:1787863116.084345:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089408 00000100:00100000:0.0:1787863116.084436:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1787863116.084447:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17771:x1874709517089408:12345-192.168.202.60@tcp:13:lfs.0 00002000:00000024:0.0:1787863116.084490:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863116.084598:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfe61ff8-722b-424a-b548-843f4f74cf11+6:17771:x1874709517089408:12345-192.168.202.60@tcp:13:lfs.0 Request processed in 153us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.084606:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00080000:1.0:1787863116.084792:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787863116.189885:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863116.333857:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.333989:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089536 00000100:00100000:0.0:1787863116.334009:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089536 00000100:00100000:0.0:1787863116.334140:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:0.0:1787863116.334154:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+10:17804:x1874709517089536:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787863116.334174:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863116.334211:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534636400/0x9c5536ccf8931af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d40 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863116.334247:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636400/0x9c5536ccf8931af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d40 expref: 11 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863116.334259:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534636400/0x9c5536ccf8931af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d40 expref: 11 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863116.334270:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636400, rc 0) 00000100:00100000:0.0:1787863116.334352:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+11:17804:x1874709517089536:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 202us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.334359:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:3.0:1787863116.353471:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.353632:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089664 00000100:00100000:0.0:1787863116.353653:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089664 00000100:00100000:0.0:1787863116.353748:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:0.0:1787863116.353760:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+11:17804:x1874709517089664:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787863116.354176:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+11:17804:x1874709517089664:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 416us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.354194:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:1.0:1787863116.375636:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863116.375817:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089792 00000100:00100000:2.0:1787863116.375833:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089792 00000100:00100000:2.0:1787863116.375921:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:2.0:1787863116.375934:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+11:17804:x1874709517089792:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787863116.376340:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+11:17804:x1874709517089792:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 407us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.376349:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:3.0:1787863116.410019:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863116.410350:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517089920 00000100:00100000:2.0:1787863116.410365:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517089920 00000100:00100000:2.0:1787863116.410452:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:2.0:1787863116.410467:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+11:17810:x1874709517089920:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787863116.410922:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+11:17810:x1874709517089920:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 457us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.410932:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:3.0:1787863116.432927:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.433099:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090048 00000100:00100000:0.0:1787863116.433115:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090048 00000100:00100000:0.0:1787863116.433206:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:0.0:1787863116.433222:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+11:17810:x1874709517090048:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787863116.433715:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+11:17810:x1874709517090048:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 495us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.433727:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:3.0:1787863116.444625:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787863116.444809:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787863116.444849:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526534400:0@lo:400:kworker.0 00000100:00100000:2.0:1787863116.444965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863116.446301:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526534016:0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.446636:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863116.446844:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787863116.446858:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526534528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787863116.446893:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863116.446940:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526534144:0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.447117:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534400 00000100:00100000:3.0:1787863116.447125:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534400 00000100:00100000:3.0:1787863116.447184:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787863116.447195:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526534400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.447269:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526534400:12345-0@lo:400:kworker.0 Request processed in 75us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.447278:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787863116.447350:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526534400:0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.447391:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534016 00000100:00100000:3.0:1787863116.447396:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534016 00000100:00100000:3.0:1787863116.447420:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787863116.447427:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3283:x1874709526534016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.447485:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3283:x1874709526534016:12345-0@lo:400:kworker.0 Request processed in 58us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.447492:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787863116.447527:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3283:1874709526534016:0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.447575:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526534272:0@lo:400:kworker.0 00000100:00100000:3.0:1787863116.447606:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534528 00000100:00100000:3.0:1787863116.447609:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534528 00000100:00100000:3.0:1787863116.447764:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787863116.447773:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526534528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787863116.447791:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787863116.447835:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526534528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.447842:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787863116.447872:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787863116.447896:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526534528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787863116.448158:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863116.448219:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090176 00000100:00100000:2.0:1787863116.448228:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090176 00000100:00100000:2.0:1787863116.448299:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:2.0:1787863116.448314:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+11:17804:x1874709517090176:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787863116.448337:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863116.448385:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6510a17200/0x9c5536ccf8931afc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d6a expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863116.448426:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6510a17200/0x9c5536ccf8931afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d6a expref: 12 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863116.448441:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6510a17200/0x9c5536ccf8931afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d6a expref: 12 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863116.448454:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17200, rc 0) 00000100:00080000:1.0:1787863116.448919:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787863116.452258:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+12:17804:x1874709517090176:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 3923us (4084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.452273:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:0.0:1787863116.456661:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863116.456751:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863116.456802:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526534784:0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.456865:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863116.456937:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534784 00000100:00100000:0.0:1787863116.456945:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534784 00000100:00100000:0.0:1787863116.457024:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787863116.457033:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526534784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457127:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526534784:12345-0@lo:400:kworker.0 Request processed in 97us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.457134:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787863116.457188:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526534784:0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457227:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526534656:0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457243:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863116.457257:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534656 00000100:00100000:0.0:1787863116.457260:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534656 00000100:00100000:0.0:1787863116.457274:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787863116.457277:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526534656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457295:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526534656:12345-0@lo:400:kworker.0 Request processed in 18us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.457299:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787863116.457313:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526534656:0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457335:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534144 00000100:00100000:0.0:1787863116.457337:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534144 00000100:00100000:0.0:1787863116.457352:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534272 00000100:00100000:0.0:1787863116.457365:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534272 00000100:00100000:0.0:1787863116.457387:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787863116.457391:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526534144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457420:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526534144:12345-0@lo:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.457426:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787863116.457436:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863116.457442:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526534272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457471:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526534272:12345-0@lo:400:kworker.0 Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.457478:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787863116.457503:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526534272:0@lo:400:kworker.0 00000100:00100000:0.0:1787863116.457524:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526534144:0@lo:400:kworker.0 00000100:00080000:0.0:1787863116.458939:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787863116.458947:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787863116.465514:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.465666:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090304 00000100:00100000:3.0:1787863116.465696:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090304 00000100:00100000:3.0:1787863116.465768:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:3.0:1787863116.465781:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6526c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+12:17804:x1874709517090304:12345-192.168.202.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787863116.465821:0:23746:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787863116.465848:0:23746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787863116.465858:0:23746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787863116.465861:0:23746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787863116.465863:0:23746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1787863116.473130:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6526c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+12:17804:x1874709517090304:12345-192.168.202.60@tcp:256:mount.lustre.0 Request processed in 7331us (7614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.473158:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:2.0:1787863116.484340:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.486627:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090432 00000100:00100000:0.0:1787863116.486652:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090432 00000100:00100000:0.0:1787863116.486730:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:0.0:1787863116.486744:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+12:17804:x1874709517090432:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787863116.486770:0:23745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863116.486798:0:23745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d71 expref: -99 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863116.486859:0:23745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 13 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863116.486873:0:23745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 13 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863116.486884:0:23745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637400, rc 0) 00000100:00100000:0.0:1787863116.486983:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17804:x1874709517090432:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 242us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.486992:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:1.0:1787863116.495020:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.495170:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090560 00000100:00100000:3.0:1787863116.495185:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090560 00000100:00100000:2.0:1787863116.495606:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:2.0:1787863116.495627:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:17804:x1874709517090560:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787863116.496218:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:17804:x1874709517090560:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 595us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.496230:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:0.0:1787863116.500483:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863116.503332:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090688 00000100:00100000:1.0:1787863116.503358:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090688 00000100:00100000:1.0:1787863116.503454:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787863116.503466:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17804:x1874709517090688:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787863116.503833:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17804:x1874709517090688:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 365us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863116.503845:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000001:00100000:1.0:1787863116.510775:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dfe61ff8-722b-424a-b548-843f4f74cf11 00000100:00100000:2.0:1787863116.512510:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863116.512662:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090816 00000100:00100000:1.0:1787863116.512678:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090816 00000100:00100000:1.0:1787863116.512771:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:1.0:1787863116.512789:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17814:x1874709517090816:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787863116.513664:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17814:x1874709517090816:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 870us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863116.513681:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:0.0:1787863116.537683:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.537996:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517090944 00000100:00100000:3.0:1787863116.538012:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517090944 00000100:00100000:3.0:1787863116.538116:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:3.0:1787863116.538130:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+13:17814:x1874709517090944:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787863116.538990:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+13:17814:x1874709517090944:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 855us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.539005:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:0.0:1787863116.550557:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.550729:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.550763:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863116.550834:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091584 00000100:00100000:1.0:1787863116.550849:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091584 00000100:00100000:1.0:1787863116.550942:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:1.0:1787863116.550986:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517091584:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863116.551117:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517091584:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 144us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863116.551127:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787863116.567687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863116.567961:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091712 00000100:00100000:2.0:1787863116.568008:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091712 00000100:00100000:2.0:1787863116.568116:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:2.0:1787863116.568129:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517091712:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863116.568243:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517091712:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 108us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.568252:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1787863116.569316:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091072 00000100:00100000:3.0:1787863116.569332:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091072 00000100:00100000:3.0:1787863116.569388:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091456 00000100:00100000:3.0:1787863116.569392:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091456 00000100:00100000:3.0:1787863116.569424:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1787863116.569434:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2349:x1874709517091456:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863116.569526:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2349:x1874709517091456:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 94us (18762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.569544:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1787863116.569562:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787863116.569568:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1874709517091072:12345-192.168.202.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787863116.569598:0:23752:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from e8602b08-1200-4083-9eda-e1ca27e3ef35@192.168.202.60@tcp t0 exp 0000000000000000 cur 842 last 0 00000020:00000080:3.0:1787863116.569650:0:23752:0:(genops.c:1385:class_connect()) connect: client e8602b08-1200-4083-9eda-e1ca27e3ef35, cookie 0x9c5536ccf8931b0a 00000004:00100000:3.0:1787863116.569710:0:23752:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787863116.569888:0:23752:0:(import.c:65:import_set_state_nolock()) ffff9a6537e6c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787863116.569946:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2345:x1874709517091072:12345-192.168.202.60@tcp:38:mount.lustre.0 Request processed in 377us (19417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.569954:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:0.0:1787863116.576356:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.576594:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091328 00000100:00100000:3.0:1787863116.576611:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091328 00000100:00100000:3.0:1787863116.576741:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:3.0:1787863116.576778:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17804:x1874709517091328:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787863116.576847:0:23752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787863116.576954:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17804:x1874709517091328:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 180us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.576963:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00080000:0.0:1787863116.578988:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787863116.580084:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.580176:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091200 00000100:00100000:3.0:1787863116.580191:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091200 00000100:00100000:3.0:1787863116.580270:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1787863116.580282:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:0:x1874709517091200:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787863116.580337:0:23752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787863116.580617:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:0:x1874709517091200:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 337us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.580626:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787863116.584138:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.584261:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091840 00000100:00100000:0.0:1787863116.584274:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091840 00000100:00100000:0.0:1787863116.584476:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:0.0:1787863116.584490:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17804:x1874709517091840:12345-192.168.202.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787863116.584645:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17804:x1874709517091840:12345-192.168.202.60@tcp:40:mount.lustre.0 Request processed in 157us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863116.584655:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:0.0:1787863116.590027:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.590123:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863116.590215:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.590308:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092224 00000100:00100000:3.0:1787863116.590323:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092224 00000100:00100000:3.0:1787863116.590398:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787863116.590409:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17804:x1874709517092224:12345-192.168.202.60@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787863116.590762:0:23756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787863116.590917:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17804:x1874709517092224:12345-192.168.202.60@tcp:33:mount.lustre.0 Request processed in 508us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.590933:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1787863116.603303:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517091968 00000100:00100000:2.0:1787863116.603331:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517091968 00000100:00100000:2.0:1787863116.608685:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092096 00000100:00100000:2.0:1787863116.608714:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092096 00000100:00100000:2.0:1787863116.608772:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787863116.608783:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874709517091968:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787863116.608828:0:24437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e8602b08-1200-4083-9eda-e1ca27e3ef35@192.168.202.60@tcp t0 exp 0000000000000000 cur 842 last 0 00000020:00000080:2.0:1787863116.608887:0:24437:0:(genops.c:1385:class_connect()) connect: client e8602b08-1200-4083-9eda-e1ca27e3ef35, cookie 0x9c5536ccf8931b11 00002000:00100000:2.0:1787863116.608904:0:24437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e8602b08-1200-4083-9eda-e1ca27e3ef35/ffff9a651c1b3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787863116.608920:0:24437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787863116.610799:0:24437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787863116.610864:0:24437:0:(import.c:65:import_set_state_nolock()) ffff9a6526c7d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863116.611138:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2345:x1874709517091968:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 2352us (21010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.611152:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787863116.611202:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787863116.611210:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874709517092096:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787863116.612817:0:24437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from e8602b08-1200-4083-9eda-e1ca27e3ef35@192.168.202.60@tcp t0 exp 0000000000000000 cur 842 last 0 00000020:00000080:2.0:1787863116.612893:0:24437:0:(genops.c:1385:class_connect()) connect: client e8602b08-1200-4083-9eda-e1ca27e3ef35, cookie 0x9c5536ccf8931b18 00002000:00100000:2.0:1787863116.612912:0:24437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e8602b08-1200-4083-9eda-e1ca27e3ef35/ffff9a6526c7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787863116.612928:0:24437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787863116.614973:0:24437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787863116.615075:0:24437:0:(import.c:65:import_set_state_nolock()) ffff9a6526c7f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787863116.615894:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2345:x1874709517092096:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 4674us (25669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863116.615915:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787863116.808856:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863116.809117:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092352 00000100:00100000:3.0:1787863116.809134:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092352 00000100:00100000:3.0:1787863116.809301:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787863116.809317:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:17835:x1874709517092352:12345-192.168.202.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787863116.809360:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863116.809667:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931b1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34d9b expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863116.809831:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863116.809849:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863116.809867:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863116.810513:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787863116.810521:0:23752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787863116.810625:0:23752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863116.810663:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 8 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863116.810698:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 7 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863116.810725:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787863116.810728:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787863116.810733:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:3.0:1787863116.810985:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+7:17835:x1874709517092352:12345-192.168.202.60@tcp:101:mkdir.0 Request processed in 1670us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863116.810994:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00010000:00010000:1.0:1787863117.220598:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863117.981342:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787863117.981375:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526534912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787863117.985128:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863117.985258:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526534912 00000100:00100000:1.0:1787863117.985276:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526534912 00000100:00100000:1.0:1787863117.985369:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787863117.985382:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526534912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787863117.985437:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787863117.985549:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526534912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863117.985558:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787863117.985860:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526534912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787863118.239643:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787863118.608065:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dfe61ff8-722b-424a-b548-843f4f74cf11 00000001:00100000:1.0:1787863118.608084:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e8602b08-1200-4083-9eda-e1ca27e3ef35 00000040:00080000:1.0:1787863118.748746:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1787863119.110600:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e8602b08-1200-4083-9eda-e1ca27e3ef35 00010000:00010000:1.0:1787863119.262537:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787863120.040106:0:25712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787863120.284573:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863121.308333:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863121.564534:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526535424:0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.565759:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526535040:0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.565856:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863121.565935:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526535552:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.570211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863121.570324:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526535168:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.570381:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863121.570401:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526535680:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.570419:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863121.570437:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787863121.570443:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526535296:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.570461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863121.570820:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535168 00000100:00100000:0.0:1787863121.570829:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535168 00000100:00100000:0.0:1787863121.570887:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535296 00000100:00100000:0.0:1787863121.570890:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535296 00000100:00100000:1.0:1787863121.572420:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863121.572480:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787863121.572522:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526535168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.572532:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535424 00000100:00100000:1.0:1787863121.572544:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535424 00000100:00100000:1.0:1787863121.572598:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535680 00000100:00100000:1.0:1787863121.572602:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535680 00000100:00100000:1.0:1787863121.572626:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535552 00000100:00100000:1.0:1787863121.572630:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535552 00000100:00100000:1.0:1787863121.572673:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787863121.572682:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526535424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.572780:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526535424:12345-0@lo:400:kworker.0 Request processed in 98us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863121.572792:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787863121.572817:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787863121.572824:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526535680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.572873:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526535168:12345-0@lo:400:kworker.0 Request processed in 369us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863121.572885:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787863121.572893:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526535680:12345-0@lo:400:kworker.0 Request processed in 67us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863121.572902:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787863121.572916:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787863121.572927:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787863121.572936:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526535296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.572947:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526535552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.573418:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526535552:12345-0@lo:400:kworker.0 Request processed in 477us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863121.573425:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787863121.573456:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535040 00000100:00100000:1.0:1787863121.573462:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535040 00000100:00100000:1.0:1787863121.573510:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787863121.573518:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3284:x1874709526535040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.573561:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3284:x1874709526535040:12345-0@lo:400:kworker.0 Request processed in 44us (7705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863121.573567:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787863121.573643:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526535552:0@lo:400:kworker.0 00000100:00100000:1.0:1787863121.573682:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526535040:0@lo:400:kworker.0 00000100:00100000:2.0:1787863121.574608:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526535808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787863121.574685:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863121.574737:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535808 00000100:00100000:2.0:1787863121.574743:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535808 00000100:00100000:2.0:1787863121.574788:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787863121.574796:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526535808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787863121.574843:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787863121.574907:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526535808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.574915:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787863121.574964:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526535808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863121.576859:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526535296:12345-0@lo:400:kworker.0 Request processed in 3919us (6383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863121.576904:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787863121.577414:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787863121.577422:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787863121.577425:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787863121.577528:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526535296:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.577557:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526535168:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.577575:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526535680:0@lo:400:kworker.0 00000100:00100000:0.0:1787863121.577828:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526535424:0@lo:400:kworker.0 00000100:00100000:2.0:1787863121.622573:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622641:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622687:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622714:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622787:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863121.622840:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092480 00000100:00100000:2.0:1787863121.622856:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092480 00000100:00100000:2.0:1787863121.622930:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:2.0:1787863121.622946:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:2348:x1874709517092480:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623070:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:2348:x1874709517092480:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 129us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623079:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:2.0:1787863121.623132:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092864 00000100:00100000:2.0:1787863121.623136:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092864 00000100:00100000:2.0:1787863121.623176:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093120 00000100:00100000:2.0:1787863121.623180:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093120 00000100:00100000:2.0:1787863121.623200:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093248 00000100:00100000:2.0:1787863121.623202:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093248 00000100:00100000:2.0:1787863121.623215:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092736 00000100:00100000:2.0:1787863121.623218:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092736 00000100:00100000:2.0:1787863121.623232:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787863121.623240:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517092864:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623270:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517092864:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623276:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787863121.623288:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787863121.623293:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517093120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623340:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517093120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 47us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623347:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787863121.623357:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787863121.623363:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517093248:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623383:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517093248:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 20us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623389:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787863121.623398:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787863121.623404:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2348:x1874709517092736:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623426:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2348:x1874709517092736:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 22us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623432:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787863121.623450:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092608 00000100:00100000:2.0:1787863121.623454:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092608 00000100:00100000:2.0:1787863121.623484:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517092992 00000100:00100000:2.0:1787863121.623499:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517092992 00000100:00100000:2.0:1787863121.623516:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1787863121.623521:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2348:x1874709517092608:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623578:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2348:x1874709517092608:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 56us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623585:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1787863121.623597:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:2.0:1787863121.623603:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517092992:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863121.623631:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517092992:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863121.623637:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00080000:2.0:1787863121.623841:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787863121.623848:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787863121.623851:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787863121.662885:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e8602b08-1200-4083-9eda-e1ca27e3ef35 00010000:00010000:3.0:1787863122.364283:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863123.101363:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526535936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863123.101485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863123.101596:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526535936 00000100:00100000:3.0:1787863123.101608:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526535936 00000100:00100000:3.0:1787863123.101688:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787863123.101701:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526535936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787863123.101754:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787863123.101812:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526535936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863123.101820:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787863123.101846:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787863123.101928:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526535936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787863123.356245:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863124.385800:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787863124.457913:0:25862:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbeadbe40 20000000:00000080:3.0:1787863124.457947:0:25862:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6402dee800 uarg=0000000000000000 20000000:01000000:3.0:1787863124.458002:0:25862:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787863124.458010:0:25862:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787863124.458017:0:25862:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787863124.461271:0:25863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787863124.461701:0:25862:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787863124.477407:0:25862:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787863124.477690:0:25862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477723:0:25862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 18 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477732:0:25862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 18 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477738:0:25862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477748:0:25862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 12 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477755:0:25862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 12 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477762:0:25862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477822:0:25862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 12 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.477843:0:25862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 12 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.477859:0:25862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536064:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863124.477996:0:25862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 12 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.478005:0:25862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 12 pid: 23746 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.478022:0:25862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536192:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863124.478085:0:25862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.478093:0:25862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.478103:0:25862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402ade1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536320:0@lo:104: 00000100:00100000:1.0:1787863124.478158:0:25862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787863124.478419:0:25862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 18 pid: 23745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.478429:0:25862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 18 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.478438:0:25862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536448:0@lo:104: 00000100:00100000:1.0:1787863124.478475:0:25862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787863124.478511:0:25862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 18 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.478519:0:25862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 18 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.478527:0:25862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536576:0@lo:104: 00000100:00100000:1.0:1787863124.478550:0:25862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863124.478561:0:25862:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509144480 going to sleep for 11 seconds 00000100:00100000:3.0:1787863124.478942:0:23736:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787863124.479178:0:23735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526536320 00000100:00100000:2.0:1787863124.479188:0:23735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526536320 00000100:00100000:3.0:1787863124.479409:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526536448 00000100:00100000:3.0:1787863124.479419:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526536448 00000100:00100000:3.0:1787863124.479469:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526536576 00000100:00100000:3.0:1787863124.479474:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526536576 00000100:00100000:3.0:1787863124.479496:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787863124.479507:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+5:25862:x1874709526536320:12345-0@lo:104: 00010000:00010000:3.0:1787863124.479541:0:23736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863124.479821:0:23736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787863124.479830:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+5:25862:x1874709526536320:12345-0@lo:104: Request processed in 324us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863124.479841:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787863124.479872:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787863124.479879:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+4:25862:x1874709526536448:12345-0@lo:104: 00010000:00010000:3.0:1787863124.479890:0:23736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863124.479937:0:23736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787863124.479946:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+4:25862:x1874709526536448:12345-0@lo:104: Request processed in 65us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863124.479953:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787863124.479960:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787863124.479971:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863124.479990:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787863124.480001:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863124.480005:0:23740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863124.480015:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:25862:x1874709526536576:12345-0@lo:104: 00010000:00010000:1.0:1787863124.480018:0:23740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787863124.480028:0:23740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787863124.480033:0:23740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787863124.480038:0:23736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480117:0:23740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480124:0:23740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787863124.480153:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480160:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfca00/0x9c5536ccf8931989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931990 expref: -99 pid: 25153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480179:0:23740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863124.480189:0:23740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480204:0:23740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787863124.480206:0:23740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480227:0:23740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863124.480232:0:23736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1787863124.480236:0:23740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863124.480241:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+3:25862:x1874709526536576:12345-0@lo:104: Request processed in 229us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863124.480267:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:1.0:1787863124.480268:0:23740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787863124.480442:0:23741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863124.480506:0:23740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480513:0:23740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787863124.480564:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526536832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787863124.480686:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787863124.480751:0:23740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480759:0:23740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6510a16600/0x9c5536ccf8931839 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8931840 expref: -99 pid: 24433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.480770:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863124.480772:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863124.480773:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863124.480792:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402ade940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526536704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863124.480833:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863124.480873:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526536832 00000100:00100000:1.0:1787863124.480879:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526536832 00010000:00010000:1.0:1787863124.480906:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 19 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.480929:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526536704 00000100:00100000:1.0:1787863124.480932:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526536704 00010000:00010000:1.0:1787863124.480955:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 20 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.480971:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787863124.480980:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+20:3281:x1874709526536832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863124.480992:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863124.480998:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 20 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.481008:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 20 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.481028:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787863124.484827:0:25862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402ade1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536320:0@lo:104: 00010000:00010000:0.0:1787863124.485779:0:25862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf8931840 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8931839 expref: 20 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863124.485803:0:25862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536448:0@lo:104: 00000100:00100000:0.0:1787863124.485818:0:25862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536576:0@lo:104: 00010000:00010000:3.0:1787863124.486806:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863124.486812:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787863124.486815:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863124.486856:0:23741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863124.486868:0:23741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17400 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787863124.486873:0:23741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863124.486885:0:23741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787863124.486914:0:23741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787863124.486921:0:23741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787863124.487022:0:23741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863124.487241:0:23741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787863124.487567:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3281:x1874709526536832:12345-0@lo:103:ldlm_bl.0 Request processed in 6574us (6868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863124.487588:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787863124.487647:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787863124.487667:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:3284:x1874709526536704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863124.487688:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863124.487697:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.487712:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.487735:0:23737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b78600/0x9c5536ccf8931990 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8931989 expref: 18 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.487754:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863124.487856:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:3284:x1874709526536704:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (7021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863124.487863:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787863124.487916:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526536960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787863124.487938:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402ade940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3284:1874709526536704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787863124.487987:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863124.488080:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526536960 00000100:00100000:3.0:1787863124.488091:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526536960 00010000:00010000:3.0:1787863124.488127:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 17 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.488285:0:23738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787863124.488297:0:23738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:3282:x1874709526536960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863124.488309:0:23738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863124.488316:0:23738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 17 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.488326:0:23738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 17 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.488342:0:23738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b79c00/0x9c5536ccf89317f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf89317ec expref: 17 pid: 23747 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.488357:0:23738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863124.488422:0:23738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:3282:x1874709526536960:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863124.488429:0:23738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787863124.488685:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526536960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787863124.489545:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863124.489584:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863124.489673:0:23739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093376 00000100:00100000:1.0:1787863124.489682:0:23739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093376 00010000:00010000:1.0:1787863124.489720:0:23739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 13 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.489760:0:23739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093504 00000100:00100000:1.0:1787863124.489780:0:23739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093504 00010000:00010000:1.0:1787863124.489795:0:23739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 14 pid: 23746 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.489810:0:23739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:1.0:1787863124.489819:0:23739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b170930b-71af-4df4-aeea-8cf989f3465f+14:2348:x1874709517093376:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787863124.489835:0:23739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863124.489841:0:23739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 14 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.489856:0:23739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 14 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.489878:0:23739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863124.489944:0:23739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b170930b-71af-4df4-aeea-8cf989f3465f+14:2348:x1874709517093376:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 126us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863124.489953:0:23739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:1.0:1787863124.489971:0:23739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:1.0:1787863124.489978:0:23739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b170930b-71af-4df4-aeea-8cf989f3465f+13:2348:x1874709517093504:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787863124.489986:0:23739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863124.489990:0:23739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 13 pid: 23746 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490000:0:23739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 13 pid: 23746 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490016:0:23739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490038:0:23739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490084:0:23739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490092:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490099:0:23739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490107:0:23739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490114:0:23739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863124.490119:0:23739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490129:0:23739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490139:0:23739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.490151:0:23739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863124.490923:0:23739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b170930b-71af-4df4-aeea-8cf989f3465f+13:2348:x1874709517093504:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 933us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863124.490937:0:23739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00010000:00010000:1.0:1787863124.491241:0:25862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534637400/0x9c5536ccf8931b03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d71 expref: 12 pid: 23745 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.491293:0:25862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536064:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863124.491310:0:25862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6510a16200/0x9c5536ccf8931acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d0f expref: 11 pid: 23746 timeout: 950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863124.491321:0:25862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25862:1874709526536192:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863124.491365:0:25862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.491376:0:25862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.491382:0:25862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863124.491389:0:25862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863124.491531:0:23741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863124.491543:0:23741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6510a17400/0x9c5536ccf89317ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf89317f3 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863124.491563:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863124.491565:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787863124.491567:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863124.496678:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3281:1874709526536832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787863125.405206:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863125.771899:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863125.772637:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093632 00000100:00100000:1.0:1787863125.772655:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093632 00000100:00100000:1.0:1787863125.772737:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:1.0:1787863125.772749:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+11:17690:x1874709517093632:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787863125.772771:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863125.772796:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34da2 expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863125.772834:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34da2 expref: 12 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863125.772867:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a654204fe00/0x9c5536ccf8931b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34da2 expref: 12 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863125.772879:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204fe00, rc 0) 00000100:00100000:1.0:1787863125.772964:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+12:17690:x1874709517093632:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 217us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863125.772972:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:1.0:1787863125.780433:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863125.780569:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093760 00000100:00100000:2.0:1787863125.780583:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093760 00000100:00100000:2.0:1787863125.780668:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:2.0:1787863125.780679:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+12:17690:x1874709517093760:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787863125.781195:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+12:17690:x1874709517093760:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 516us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863125.781206:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:3.0:1787863125.802234:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863125.805938:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517093888 00000100:00100000:2.0:1787863125.805961:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517093888 00000100:00100000:2.0:1787863125.806116:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:2.0:1787863125.806131:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+12:17690:x1874709517093888:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787863125.806510:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+12:17690:x1874709517093888:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 380us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863125.806531:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:3.0:1787863125.830749:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863125.831567:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094016 00000100:00100000:1.0:1787863125.831585:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094016 00000100:00100000:1.0:1787863125.831671:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 110 00000100:00100000:1.0:1787863125.831683:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+12:17690:x1874709517094016:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787863125.831704:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863125.831730:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a654204ee00/0x9c5536ccf8931b3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34da9 expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863125.831770:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a654204ee00/0x9c5536ccf8931b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34da9 expref: 13 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863125.831784:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a654204ee00/0x9c5536ccf8931b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34da9 expref: 13 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863125.831794:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ee00, rc 0) 00000100:00100000:1.0:1787863125.831871:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+13:17690:x1874709517094016:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 190us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863125.831878:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 110 00000100:00100000:3.0:1787863125.841945:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863125.842948:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094144 00000100:00100000:1.0:1787863125.842965:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094144 00000100:00100000:1.0:1787863125.843093:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 111 00000100:00100000:1.0:1787863125.843109:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17690:x1874709517094144:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787863125.843565:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b170930b-71af-4df4-aeea-8cf989f3465f+13:17690:x1874709517094144:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 458us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863125.843577:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 111 00000100:00100000:3.0:1787863125.847770:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863125.847984:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094272 00000100:00100000:2.0:1787863125.847999:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094272 00000100:00100000:2.0:1787863125.848123:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:2.0:1787863125.848135:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:17690:x1874709517094272:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787863125.848505:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:17690:x1874709517094272:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 370us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863125.848514:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:2.0:1787863126.218327:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.218522:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094400 00000100:00100000:3.0:1787863126.218537:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094400 00000100:00100000:3.0:1787863126.218836:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1787863126.218853:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:18301:x1874709517094400:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787863126.218906:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863126.218937:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931b42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34db0 expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.219038:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.219104:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.219118:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.219192:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.219200:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.219208:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787863126.219885:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787863126.221310:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931b57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221337:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931b57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221352:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931b57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863126.221474:0:23753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787863126.221487:0:23753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787863126.221626:0:23753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931b57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221643:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221650:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221657:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221664:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.221669:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221678:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221694:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787863126.221698:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.221704:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221712:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221729:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221736:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221752:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221758:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfde00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.221761:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221767:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221775:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6517c53800) 00010000:00010000:3.0:1787863126.221778:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.221781:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221787:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221838:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931b42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34db0 expref: 8 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221855:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931b57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34db0 expref: 7 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.221862:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:3.0:1787863126.221864:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787863126.221867:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfda00, rc 0) 00000100:00100000:3.0:1787863126.221983:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+7:18301:x1874709517094400:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 3135us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.222004:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 10000000:01000000:3.0:1787863126.236259:0:23749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787863126.236280:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a653d6d1800 from 10 10000000:01000000:3.0:1787863126.236294:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787863126.236366:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.236381:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.236396:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863126.236431:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787863126.236554:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863126.236923:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863126.237810:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537088 00000100:00100000:1.0:1787863126.237824:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537088 00000100:00100000:1.0:1787863126.237907:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787863126.237920:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+16:23749:x1874709526537088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787863126.237943:0:23747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863126.237969:0:23747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a654204f200/0x9c5536ccf8931b65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931b5e expref: -99 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.238013:0:23747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a654204f200/0x9c5536ccf8931b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931b5e expref: 17 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.238027:0:23747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a654204f200/0x9c5536ccf8931b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931b5e expref: 17 pid: 23747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.238086:0:23747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f200, rc 0) 00000100:00100000:1.0:1787863126.238186:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:23749:x1874709526537088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.238194:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787863126.241860:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787863126.241906:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931b65 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.241923:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931b65 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863126.242115:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787863126.242207:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863126.242258:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863126.242600:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537216 00000100:00100000:1.0:1787863126.242611:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537216 00000100:00100000:1.0:1787863126.242684:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787863126.242714:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:23749:x1874709526537216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787863126.243139:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:23749:x1874709526537216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 425us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.243150:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787863126.243494:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.243560:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.243627:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.243674:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193240 going to sleep for 11 seconds 00000100:00100000:0.0:1787863126.243823:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537344 00000100:00100000:0.0:1787863126.243830:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537344 00000100:00100000:0.0:1787863126.243883:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787863126.243892:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:23749:x1874709526537344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787863126.244142:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:23749:x1874709526537344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.244150:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787863126.244984:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863126.245225:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787863126.246345:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094656 00000100:00100000:3.0:1787863126.246359:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094656 00000100:00100000:3.0:1787863126.246483:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1787863126.246496:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:18301:x1874709517094656:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787863126.246527:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863126.246576:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34db7 expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.246919:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.246938:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.246955:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.246972:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.246978:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.246985:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787863126.250247:0:25876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787863126.250801:0:23749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787863126.250837:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787863126.250855:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931b65 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.250871:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf8931b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931b65 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787863126.250885:0:23749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787863126.250889:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a651fe85000 from 10 10000000:01000000:2.0:1787863126.250908:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787863126.250965:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.250975:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.250999:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863126.251035:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.251165:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.251237:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193240 going to sleep for 11 seconds 00000100:00100000:0.0:1787863126.251370:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537472 00000100:00100000:0.0:1787863126.251380:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537472 00000100:00100000:0.0:1787863126.251658:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787863126.251682:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+17:23749:x1874709526537472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787863126.251702:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863126.251719:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637000/0x9c5536ccf8931b88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931b81 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.251754:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637000/0x9c5536ccf8931b88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931b81 expref: 18 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.251768:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637000/0x9c5536ccf8931b88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931b81 expref: 18 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.251779:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637000, rc 0) 00000100:00100000:0.0:1787863126.251850:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526537472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.251868:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787863126.253014:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787863126.253084:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931b88 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.253100:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931b88 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863126.253220:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.253291:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.253342:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193240 going to sleep for 11 seconds 00010000:00010000:3.0:1787863126.253897:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931b8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.253915:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.253928:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863126.253966:0:23754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00100000:1.0:1787863126.254105:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537600 00000100:00100000:1.0:1787863126.254115:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537600 00000100:00100000:1.0:1787863126.254173:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787863126.254184:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526537600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787863126.259371:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526537600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5173us (6064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.259392:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787863126.265826:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.265931:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.266123:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.266183:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193240 going to sleep for 11 seconds 00000100:00100000:2.0:1787863126.266224:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537728 00000100:00100000:2.0:1787863126.266234:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537728 00000100:00100000:2.0:1787863126.266307:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787863126.266318:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526537728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787863126.266622:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526537728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863126.266631:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787863126.266689:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537728:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1787863126.267271:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267287:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267296:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267305:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.267310:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267320:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267340:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:3.0:1787863126.267344:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.267351:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267359:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931b73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267378:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267384:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267403:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267409:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.267412:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267419:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267428:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6517c53500) 00010000:00010000:3.0:1787863126.267430:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.267434:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.267439:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931b7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787863126.275882:0:25877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00010000:00010000:3.0:1787863126.276507:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931b6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34db7 expref: 10 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.276562:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931b8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34db7 expref: 9 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.276575:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:3.0:1787863126.276578:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.276583:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd200, rc 0) 00000100:00100000:3.0:1787863126.277758:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18301:x1874709517094656:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 31256us (32770us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787863126.277798:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:2.0:1787863126.278848:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.278981:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094784 00000100:00100000:3.0:1787863126.279230:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094784 00000100:00100000:3.0:1787863126.279894:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:3.0:1787863126.279907:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18307:x1874709517094784:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787863126.279936:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863126.279962:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34dbe expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.285143:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.285180:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.285198:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863126.290328:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.290926:0:23754:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787863126.290942:0:23754:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:2.0:1787863126.291228:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291258:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291276:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291787:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291804:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291810:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291816:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863126.291819:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1787863126.291825:0:23749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 00010000:00010000:2.0:1787863126.291826:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291850:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787863126.291853:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.291857:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291862:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291876:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291880:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291884:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291888:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc1f2a4f0) 10000000:01000000:0.0:1787863126.291889:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787863126.291898:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291910:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.291911:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931b88 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291919:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a6507fe6700) 00010000:00010000:2.0:1787863126.291929:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.291936:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.291940:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6510a16400/0x9c5536ccf8931b81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931b88 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.291955:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.292016:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931b9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dbe expref: 10 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.292028:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787863126.292031:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.292035:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dbe expref: 10 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.292077:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787863126.292163:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18307:x1874709517094784:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 12257us (13321us total) trans 0 rc 301/301 00000100:00100000:2.0:1787863126.292170:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:2.0:1787863126.292338:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517094912 00000100:00100000:2.0:1787863126.292348:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517094912 00000100:00100000:2.0:1787863126.292408:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:2.0:1787863126.292419:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18301:x1874709517094912:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 10000000:01000000:0.0:1787863126.292524:0:23749:0:(mgc_request.c:611:do_requeue()) updating log params 00000100:00100000:2.0:1787863126.292530:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18301:x1874709517094912:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 Request processed in 110us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863126.292536:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 10000000:01000000:0.0:1787863126.292728:0:23749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6527360000 from 10 10000000:01000000:0.0:1787863126.292734:0:23749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787863126.292791:0:23749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.292804:0:23749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.292831:0:23749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863126.292867:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787863126.292965:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863126.293038:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787863126.293132:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537856 00000100:00100000:2.0:1787863126.293150:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537856 00000100:00100000:3.0:1787863126.296008:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863126.296299:0:23761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517095040 00000100:00100000:2.0:1787863126.296312:0:23761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517095040 00000100:00100000:2.0:1787863126.296487:0:23761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1787863126.296498:0:23761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18307:x1874709517095040:12345-192.168.202.60@tcp:700:lfs.0 00000100:00100000:2.0:1787863126.296595:0:23761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18307:x1874709517095040:12345-192.168.202.60@tcp:700:lfs.0 Request processed in 98us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863126.296603:0:23761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787863126.296953:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787863126.296968:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+18:23749:x1874709526537856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787863126.296986:0:23746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863126.297031:0:23746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637a00/0x9c5536ccf8931bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8931bb2 expref: -99 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.297092:0:23746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637a00/0x9c5536ccf8931bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8931bb2 expref: 19 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.297108:0:23746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637a00/0x9c5536ccf8931bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8931bb2 expref: 19 pid: 23746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.297121:0:23746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637a00, rc 0) 00000100:00100000:0.0:1787863126.297198:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526537856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.297206:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787863126.297315:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787863126.297345:0:23749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931bb9 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.297385:0:23749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8931bb9 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863126.298483:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787863126.298926:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863126.298977:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787863126.299201:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526537984 00000100:00100000:1.0:1787863126.299210:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526537984 00000100:00100000:1.0:1787863126.299274:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787863126.299287:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526537984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787863126.299710:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526537984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.299720:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787863126.299761:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.299806:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517095296 00000100:00100000:1.0:1787863126.299813:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517095296 00000100:00100000:1.0:1787863126.299862:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787863126.299872:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18307:x1874709517095296:12345-192.168.202.60@tcp:36:lfs.0 00010000:00010000:1.0:1787863126.299933:0:23752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863126.299973:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931aee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d39 expref: 9 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.300019:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787863126.300026:0:23752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787863126.300293:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.300311:0:23752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 5 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.300323:0:23752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.300372:0:23752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 5 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.300391:0:23752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 5 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863126.300409:0:23752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526538112:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787863126.300512:0:23752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506703240 going to sleep for 11 seconds 00000100:00100000:0.0:1787863126.301015:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526537984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787863126.301103:0:23749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526538240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787863126.301177:0:23749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863126.301217:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526538240 00000100:00100000:0.0:1787863126.301223:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526538240 00000100:00100000:0.0:1787863126.301276:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787863126.301286:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526538240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787863126.301804:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:23749:x1874709526538240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 518us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.301816:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787863126.301889:0:23749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787863126.301907:0:23749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38779eb7-76b5-435e-9dc5-da8e02f86cb2:23749:1874709526538240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787863126.304806:0:25879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787863126.305431:0:23749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787863126.305470:0:23749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787863126.305487:0:23749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931bb9 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.305501:0:23749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534636000/0x9c5536ccf8931bb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8931bb9 expref: -99 pid: 23749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863126.305970:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.306067:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517095424 00000100:00100000:3.0:1787863126.306084:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517095424 00000100:00100000:1.0:1787863126.306123:0:23752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526538112:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863126.306170:0:23752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.306171:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 6 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787863126.306273:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787863126.306358:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1787863126.306374:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517095424:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787863126.306433:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863126.306456:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 6 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.306476:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 6 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.306538:0:23737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931b26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34d9b expref: 6 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.306556:0:23737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787863126.306561:0:23737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.306576:0:23737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.306585:0:23737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.306615:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787863126.306843:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517095424:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 474us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.306978:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00010000:00010000:2.0:1787863126.307143:0:23752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.307152:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.307192:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.307204:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.307212:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787863126.318318:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787863126.318341:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.318353:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.318361:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.318367:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863126.318371:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.318379:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.318397:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787863126.318400:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.318406:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.318427:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931bc0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787863126.318460:0:23752:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ea47a35 reply state 00000000a41f51ba transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863126.318470:0:23752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787863126.318621:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18307:x1874709517095296:12345-192.168.202.60@tcp:36:lfs.0 Request processed in 18746us (18873us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787863126.318632:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00010000:00010000:1.0:1787863126.321144:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.321168:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.321191:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.321198:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863126.321203:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.321212:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.321234:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a6507fe6700) 00010000:00010000:1.0:1787863126.321237:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787863126.321244:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.321251:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931bc7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.429560:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863126.449156:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.450079:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517095552 00000100:00100000:1.0:1787863126.450096:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517095552 00000100:00100000:1.0:1787863126.450202:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:1.0:1787863126.450217:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+9:18315:x1874709517095552:12345-192.168.202.60@tcp:101:lctl.0 00010000:00010000:1.0:1787863126.450259:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863126.450293:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34dc5 expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.450394:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e400/0x9c5536ccf8931bd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.450722:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e400/0x9c5536ccf8931bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.450741:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e400/0x9c5536ccf8931bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863126.450862:0:23754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787863126.450868:0:23754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:1.0:1787863126.451374:0:23754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e400/0x9c5536ccf8931bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.451532:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dc5 expref: 11 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.451572:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e400/0x9c5536ccf8931bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dc5 expref: 10 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.451583:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:1.0:1787863126.451587:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787863126.451592:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204e400, rc 0) 00000100:00100000:1.0:1787863126.452007:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18315:x1874709517095552:12345-192.168.202.60@tcp:101:lctl.0 Request processed in 1791us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.452020:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787863126.485424:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.485769:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517095680 00000100:00100000:3.0:1787863126.485784:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517095680 00000100:00100000:3.0:1787863126.485878:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:3.0:1787863126.485891:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:18316:x1874709517095680:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787863126.485947:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863126.485976:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34dcc expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.490345:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931be3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.490381:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.490398:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863126.490794:0:23753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787863126.490801:0:23753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1787863126.490831:0:23753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.491315:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dcc expref: 7 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.491345:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dcc expref: 6 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.491356:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:0.0:1787863126.491360:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787863126.491365:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637400, rc 0) 00000100:00100000:0.0:1787863126.492089:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:18316:x1874709517095680:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 6146us (6638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.492102:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1787863126.498843:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.499327:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517095808 00000100:00100000:3.0:1787863126.499342:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517095808 00000100:00100000:3.0:1787863126.499424:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:3.0:1787863126.499438:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:18316:x1874709517095808:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787863126.499479:0:25878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863126.499512:0:25878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34dd3 expref: -99 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499626:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499648:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499663:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499682:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499690:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499698:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499871:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499880:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499888:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863126.499942:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787863126.499947:0:25878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787863126.499983:0:25878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.499999:0:25878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500006:0:25878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500013:0:25878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500020:0:25878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.500024:0:25878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500033:0:25878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500814:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:3.0:1787863126.500833:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.500840:0:25878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500849:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500869:0:25878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500876:0:25878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500892:0:25878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500898:0:25878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.500900:0:25878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500906:0:25878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500914:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a6517c53500) 00010000:00010000:3.0:1787863126.500917:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863126.500920:0:25878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500926:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931bf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.500982:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dd3 expref: 8 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.501424:0:25878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dd3 expref: 7 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.501433:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787863126.501435:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787863126.501438:0:25878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfde00, rc 0) 00000100:00100000:3.0:1787863126.501686:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e8602b08-1200-4083-9eda-e1ca27e3ef35+7:18316:x1874709517095808:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 2249us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.501699:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:2.0:1787863126.507866:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.508155:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517096064 00000100:00100000:1.0:1787863126.508174:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517096064 00000100:00100000:1.0:1787863126.508267:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787863126.508279:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+7:18316:x1874709517096064:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787863126.508309:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863126.508358:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34dda expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863126.508822:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787863126.512290:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dda expref: 9 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.512326:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:1.0:1787863126.512329:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787863126.512336:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dda expref: 9 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.512358:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f400, rc 0) 00000100:00100000:1.0:1787863126.512476:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+8:18316:x1874709517096064:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 4198us (4641us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787863126.512487:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787863126.518195:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.518350:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517096320 00000100:00100000:3.0:1787863126.518366:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517096320 00000100:00100000:0.0:1787863126.518897:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787863126.518913:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+8:18316:x1874709517096320:12345-192.168.202.60@tcp:36:lfs.0 00010000:00010000:0.0:1787863126.518997:0:23754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863126.519034:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf8931bff lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dd3 expref: 8 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.519089:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:0.0:1787863126.519104:0:23754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787863126.519141:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.519158:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.519194:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787863126.519535:0:23754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039190f96 reply state 00000000510eb1bf transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863126.519558:0:23754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787863126.519574:0:23754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787863126.519718:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+9:18316:x1874709517096320:12345-192.168.202.60@tcp:36:lfs.0 Request processed in 807us (1540us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787863126.519727:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787863126.535025:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.535276:0:23755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517096576 00000100:00100000:1.0:1787863126.535291:0:23755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517096576 00000100:00100000:1.0:1787863126.535368:0:23755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:1.0:1787863126.535381:0:23755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+9:18316:x1874709517096576:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787863126.535776:0:23755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+10:18316:x1874709517096576:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 397us (767us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787863126.535785:0:23755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00010000:00010000:3.0:1787863126.536659:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.536676:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.536684:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.536691:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863126.536697:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.536706:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.536725:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a650a0b6e00) 00010000:00010000:3.0:1787863126.536729:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787863126.536751:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.536759:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c14 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863126.543171:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863126.543360:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517096832 00000100:00100000:2.0:1787863126.543378:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517096832 00000100:00100000:2.0:1787863126.543472:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:2.0:1787863126.543486:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+9:18316:x1874709517096832:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787863126.543528:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863126.543573:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34de1 expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.543695:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.543718:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.543732:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.543778:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.543787:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.543795:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787863126.543999:0:23753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787863126.544191:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544200:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544207:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544215:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863126.544221:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544229:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544244:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:2.0:1787863126.544248:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.544254:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544272:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544292:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544297:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544303:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544307:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863126.544310:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544316:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544324:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a6507fe6c00) 00010000:00010000:2.0:1787863126.544327:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.544330:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544336:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544384:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931c1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de1 expref: 11 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544406:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:2.0:1787863126.544409:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787863126.544412:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de1 expref: 11 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.544422:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16a00, rc 0) 00000100:00100000:2.0:1787863126.544510:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+10:18316:x1874709517096832:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1028us (1366us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787863126.544519:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:0.0:1787863126.548356:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.549005:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517096960 00000100:00100000:1.0:1787863126.549025:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517096960 00000100:00100000:1.0:1787863126.549175:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1787863126.549189:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+10:18316:x1874709517096960:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787863126.549449:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863126.549483:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c37 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34de8 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.549901:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.549923:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.549938:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863126.550014:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787863126.550019:0:23752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787863126.550081:0:23752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.550131:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c37 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 12 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.550173:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 11 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.550184:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:1.0:1787863126.550187:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787863126.550193:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ea00, rc 0) 00000100:00100000:1.0:1787863126.551005:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+11:18316:x1874709517096960:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1810us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.551017:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:0.0:1787863126.563234:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.563308:0:23755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517097088 00000100:00100000:1.0:1787863126.563326:0:23755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517097088 00000100:00100000:1.0:1787863126.563419:0:23755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:1.0:1787863126.563433:0:23755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+11:18316:x1874709517097088:12345-192.168.202.60@tcp:37:lfs.0 00000100:00100000:2.0:1787863126.570293:0:23755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e8602b08-1200-4083-9eda-e1ca27e3ef35+11:18316:x1874709517097088:12345-192.168.202.60@tcp:37:lfs.0 Request processed in 6848us (7056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863126.570309:0:23755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:0.0:1787863126.575158:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863126.581252:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517097344 00000100:00100000:2.0:1787863126.581279:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517097344 00000100:00100000:2.0:1787863126.581383:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:2.0:1787863126.581396:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651259d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+11:18316:x1874709517097344:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787863126.581787:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651259d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+12:18316:x1874709517097344:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 392us (6652us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787863126.581796:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:3.0:1787863126.686405:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526538368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787863126.686488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.686609:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526538368 00000100:00100000:2.0:1787863126.686618:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526538368 00000100:00100000:2.0:1787863126.686684:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787863126.686695:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526538368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787863126.686736:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787863126.686796:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526538368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863126.686804:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787863126.686848:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526538368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787863126.687646:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526538752:0@lo:400:kworker.0 00000100:00100000:1.0:1787863126.687731:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863126.687779:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787863126.687786:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526538624:0@lo:400:kworker.0 00000100:00100000:1.0:1787863126.687812:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863126.687860:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526538752 00000100:00100000:1.0:1787863126.687868:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526538752 00000100:00100000:1.0:1787863126.687922:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526538624 00000100:00100000:1.0:1787863126.687925:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526538624 00000100:00080000:3.0:1787863126.687933:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787863126.687948:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787863126.687964:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787863126.687977:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526538752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863126.688016:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787863126.688038:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526538624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863126.688096:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526538752:12345-0@lo:400:kworker.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.688108:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787863126.688163:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526538752:0@lo:400:kworker.0 00000100:00100000:3.0:1787863126.688175:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526538624:12345-0@lo:400:kworker.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.688188:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787863126.688201:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526538624:0@lo:400:kworker.0 00000100:00100000:2.0:1787863126.689764:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526538496:0@lo:400:kworker.0 00000100:00100000:2.0:1787863126.689907:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.689974:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787863126.689982:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526538496 00000100:00100000:2.0:1787863126.689983:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526538880:0@lo:400:kworker.0 00000100:00100000:3.0:1787863126.689994:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526538496 00000100:00100000:2.0:1787863126.690031:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863126.690127:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526538880 00000100:00100000:2.0:1787863126.690132:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526538880 00000100:00100000:3.0:1787863126.690150:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787863126.690168:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526538496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787863126.690188:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787863126.690200:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526538880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787863126.690260:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526538496:12345-0@lo:400:kworker.0 Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.690268:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787863126.690298:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787863126.690304:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787863126.694819:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863126.695624:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526538880:12345-0@lo:400:kworker.0 Request processed in 5415us (5584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863126.695645:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787863126.695701:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517097472 00000100:00100000:2.0:1787863126.695713:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517097472 00000100:00100000:2.0:1787863126.695795:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:2.0:1787863126.696345:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18322:x1874709517097472:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787863126.696374:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863126.696401:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34def expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.696587:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.696638:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.696655:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.696675:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.696683:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.696690:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697010:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931c5a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697020:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931c5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697028:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931c5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787863126.697100:0:23753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787863126.697105:0:23753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787863126.697167:0:23753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931c5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697184:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697205:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697213:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697220:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863126.697225:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697234:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697251:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:2.0:1787863126.697690:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.697701:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697710:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697732:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697739:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697745:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697751:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863126.697764:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697771:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697782:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a6507fe6c00) 00010000:00010000:2.0:1787863126.697785:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863126.697788:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.697794:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931c53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.698631:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34def expref: 12 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.698661:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931c5a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34def expref: 11 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863126.698669:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:2.0:1787863126.698672:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787863126.698676:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16e00, rc 0) 00000100:00100000:0.0:1787863126.698793:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526538880:0@lo:400:kworker.0 00000100:00100000:2.0:1787863126.699059:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+11:18322:x1874709517097472:12345-192.168.202.60@tcp:101:bash.0 Request processed in 3238us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863126.702031:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526538496:0@lo:400:kworker.0 00000100:00100000:2.0:1787863126.705927:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:0.0:1787863126.707547:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.707699:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517097728 00000100:00100000:1.0:1787863126.707716:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517097728 00000100:00100000:1.0:1787863126.707802:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:1.0:1787863126.707814:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+11:18322:x1874709517097728:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787863126.707837:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863126.707859:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c61 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34df6 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.708212:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.708229:0:23752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 11 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.708238:0:23752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.708276:0:23752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 11 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.708292:0:23752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 11 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863126.708307:0:23752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526539008:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787863126.708425:0:23752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651149a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787863126.715950:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.716356:0:23752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526539008:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863126.716753:0:23752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863126.720228:0:23738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517097856 00000100:00100000:2.0:1787863126.720629:0:23738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517097856 00010000:00010000:3.0:1787863126.720864:0:23738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 12 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863126.721012:0:23738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787863126.721082:0:23738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+12:2348:x1874709517097856:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787863126.721105:0:23738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863126.721113:0:23738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 12 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.721132:0:23738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 12 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.721245:0:23738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931c3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34de8 expref: 12 pid: 23752 timeout: 952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.721271:0:23738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:3.0:1787863126.721277:0:23738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.721606:0:23738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.721617:0:23738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.721730:0:23738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863126.721828:0:23738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+11:2348:x1874709517097856:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 782us (5948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.721838:0:23738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00010000:00010000:0.0:1787863126.727282:0:23752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.727310:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863126.732676:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.732737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.732775:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.732809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.732867:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.733091:0:23746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517097984 00000100:00100000:3.0:1787863126.733107:0:23746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517097984 00000100:00100000:3.0:1787863126.733198:0:23746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:3.0:1787863126.733214:0:23746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:2347:x1874709517097984:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863126.733319:0:23746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b170930b-71af-4df4-aeea-8cf989f3465f+13:2347:x1874709517097984:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 109us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.733330:0:23746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:3.0:1787863126.733371:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517098112 00000100:00100000:3.0:1787863126.733374:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517098112 00000100:00100000:3.0:1787863126.733408:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517098368 00000100:00100000:3.0:1787863126.733410:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517098368 00000100:00100000:3.0:1787863126.733422:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517098240 00000100:00100000:3.0:1787863126.733424:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517098240 00000100:00100000:3.0:1787863126.733514:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517098496 00000100:00100000:3.0:1787863126.733519:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517098496 00000100:00100000:3.0:1787863126.733535:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1787863126.733543:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2347:x1874709517098112:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863126.733581:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2347:x1874709517098112:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 39us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.733588:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1787863126.733602:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1787863126.733608:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2347:x1874709517098368:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863126.733637:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2347:x1874709517098368:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.733644:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1787863126.733655:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:3.0:1787863126.733672:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2347:x1874709517098240:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863126.733700:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2347:x1874709517098240:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.733706:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:3.0:1787863126.733718:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787863126.733723:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2347:x1874709517098496:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863126.733747:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2347:x1874709517098496:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863126.733752:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00080000:3.0:1787863126.733780:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787863126.733786:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787863126.733839:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.733886:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.733904:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.738912:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.738943:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.738957:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863126.738969:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787863126.739004:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739012:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739018:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739025:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204e800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863126.739030:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739037:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739088:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:0.0:1787863126.739092:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863126.739097:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739103:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c68 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787863126.739120:0:23752:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086b96453 reply state 00000000c08c0be6 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863126.739129:0:23752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787863126.739168:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c61 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 14 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739186:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 13 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863126.739195:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863126.739197:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787863126.739200:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636a00, rc 0) 00000100:00100000:0.0:1787863126.739285:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+14:18322:x1874709517097728:12345-192.168.202.60@tcp:101:bash.0 Request processed in 31474us (31749us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1787863126.739296:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00010000:00010000:1.0:1787863126.748180:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.748205:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.748214:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.748246:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863126.748253:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.748262:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.748282:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a650a0b6600) 00010000:00010000:1.0:1787863126.748286:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787863126.748291:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.748298:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931c6f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863126.781883:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.782065:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517098624 00000100:00100000:1.0:1787863126.782077:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517098624 00000100:00100000:1.0:1787863126.782162:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:1.0:1787863126.782174:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18322:x1874709517098624:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787863126.782206:0:25878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863126.782231:0:25878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c84 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34dfd expref: -99 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782329:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782352:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782397:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863126.782464:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787863126.782471:0:25878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787863126.782503:0:25878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782518:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782553:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931c84 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dfd expref: 15 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782580:0:25878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dfd expref: 14 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863126.782589:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863126.782593:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787863126.782597:0:25878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204e800, rc 0) 00000100:00100000:1.0:1787863126.782762:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+14:18322:x1874709517098624:12345-192.168.202.60@tcp:101:bash.0 Request processed in 591us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863126.782768:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:3.0:1787863126.789187:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.789351:0:23755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517098880 00000100:00100000:1.0:1787863126.789363:0:23755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517098880 00000100:00100000:1.0:1787863126.789456:0:23755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:1.0:1787863126.789466:0:23755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+14:18322:x1874709517098880:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:1.0:1787863126.789994:0:23755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+15:18322:x1874709517098880:12345-192.168.202.60@tcp:35:bash.0 Request processed in 526us (821us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1787863126.790023:0:23755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000040:00080000:3.0:1787863126.946004:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787863126.946457:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863126.947773:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517099136 00000100:00100000:3.0:1787863126.947787:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517099136 00000100:00100000:3.0:1787863126.947855:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:3.0:1787863126.947867:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+15:18332:x1874709517099136:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787863126.947894:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863126.947917:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931c92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e04 expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863126.948074:0:23754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787863126.948204:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931c92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e04 expref: 17 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.948242:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:3.0:1787863126.948246:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787863126.948252:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931c92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e04 expref: 17 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863126.948267:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd800, rc 0) 00000100:00100000:3.0:1787863126.948352:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+16:18332:x1874709517099136:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 487us (1900us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1787863126.948360:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:0.0:1787863126.955760:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863126.955861:0:23755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517099392 00000100:00100000:1.0:1787863126.955873:0:23755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517099392 00000100:00100000:1.0:1787863126.955943:0:23755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:1.0:1787863126.955955:0:23755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+16:18332:x1874709517099392:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787863126.956275:0:23755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18332:x1874709517099392:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 321us (526us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787863126.956283:0:23755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:2.0:1787863127.036180:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863127.036433:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517099648 00000100:00100000:1.0:1787863127.036452:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517099648 00000100:00100000:1.0:1787863127.036519:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:1.0:1787863127.036529:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18335:x1874709517099648:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787863127.036555:0:25878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863127.036576:0:25878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931ca0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e0b expref: -99 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.036674:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8931ca7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.036688:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8931ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.036701:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8931ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863127.036712:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787863127.036868:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931ca0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e0b expref: 20 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.036888:0:25878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8931ca7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e0b expref: 19 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.036897:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863127.036901:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787863127.036904:0:25878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f600, rc 0) 00000100:00100000:1.0:1787863127.036971:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+19:18335:x1874709517099648:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 443us (802us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1787863127.036980:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:3.0:1787863127.040657:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863127.041085:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517099776 00000100:00100000:0.0:1787863127.041417:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517099776 00000100:00100000:0.0:1787863127.041548:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787863127.041588:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+19:2346:x1874709517099776:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787863127.041606:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863127.041632:0:23737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8931ca7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e0b expref: 19 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.041655:0:23737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863127.041661:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787863127.041749:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+18:2346:x1874709517099776:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 165us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863127.041758:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787863127.046740:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863127.046976:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517099904 00000100:00100000:3.0:1787863127.046987:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517099904 00000100:00100000:3.0:1787863127.047141:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:3.0:1787863127.047153:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+18:18335:x1874709517099904:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:3.0:1787863127.047235:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047252:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047264:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047303:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047310:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047330:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047336:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863127.047340:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047348:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047360:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:3.0:1787863127.047362:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787863127.047367:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.047373:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931cb5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863127.047467:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+18:18335:x1874709517099904:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 315us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863127.047475:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:2.0:1787863127.051519:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863127.051703:0:23755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517100160 00000100:00100000:1.0:1787863127.051714:0:23755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517100160 00000100:00100000:1.0:1787863127.051800:0:23755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:1.0:1787863127.051810:0:23755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+18:18335:x1874709517100160:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787863127.052530:0:23755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+19:18335:x1874709517100160:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 718us (1486us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1787863127.052541:0:23755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00010000:00010000:0.0:1787863127.452249:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863127.486763:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863127.486901:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517100416 00000100:00100000:0.0:1787863127.486912:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517100416 00000100:00100000:0.0:1787863127.486989:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:0.0:1787863127.487002:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+19:18366:x1874709517100416:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:0.0:1787863127.487034:0:25878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863127.487087:0:25878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931cbc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e12 expref: -99 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.487199:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cc3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.487216:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.487229:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863127.487260:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787863127.487429:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931cbc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e12 expref: 22 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.487478:0:25878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cc3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e12 expref: 21 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.487486:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863127.487488:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787863127.487492:0:25878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636c00, rc 0) 00000100:00100000:0.0:1787863127.487567:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+21:18366:x1874709517100416:12345-192.168.202.60@tcp:101:cat.0 Request processed in 567us (814us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787863127.487574:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:0.0:1787863127.495473:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863127.495658:0:23738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517100544 00000100:00100000:3.0:1787863127.495668:0:23738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517100544 00000100:00100000:3.0:1787863127.495749:0:23738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787863127.495760:0:23738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+21:2346:x1874709517100544:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787863127.495780:0:23738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863127.495810:0:23738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cc3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e12 expref: 21 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.495855:0:23738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:3.0:1787863127.495859:0:23738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863127.495927:0:23738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+20:2346:x1874709517100544:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 169us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863127.495934:0:23738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787863127.502647:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863127.502759:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517100800 00000100:00100000:2.0:1787863127.502773:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517100800 00000100:00100000:2.0:1787863127.502843:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1787863127.502853:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+20:18366:x1874709517100800:12345-192.168.202.60@tcp:35:cat.0 00000100:00100000:2.0:1787863127.503276:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+21:18366:x1874709517100800:12345-192.168.202.60@tcp:35:cat.0 Request processed in 423us (643us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1787863127.503285:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1787863127.626817:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863127.626930:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517101056 00000100:00100000:0.0:1787863127.626943:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517101056 00000100:00100000:0.0:1787863127.627019:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:0.0:1787863127.627030:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+21:18372:x1874709517101056:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1787863127.627092:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863127.627116:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931cd1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e19 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.627242:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cd8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.627261:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.627299:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863127.627314:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787863127.627505:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931cd1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e19 expref: 24 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.627528:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cd8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e19 expref: 23 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863127.627537:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863127.627541:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787863127.627545:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636c00, rc 0) 00000100:00100000:0.0:1787863127.627622:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18372:x1874709517101056:12345-192.168.202.60@tcp:101:dd.0 Request processed in 593us (817us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1787863127.627631:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:0.0:1787863127.635391:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863127.637702:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517101312 00000100:00100000:1.0:1787863127.637720:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517101312 00000100:00100000:1.0:1787863127.637810:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:1.0:1787863127.637821:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18372:x1874709517101312:12345-192.168.202.60@tcp:36:dd.0 00010000:00010000:1.0:1787863127.637891:0:25878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787863127.637924:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cd8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e19 expref: 23 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.637970:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931c8b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34dfd expref: 22 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.637982:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863127.637987:0:25878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787863127.638250:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.638265:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863127.638276:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787863127.638327:0:25878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1787863127.638352:0:25878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d85dca6c reply state 0000000092f01a10 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863127.638361:0:25878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787863127.638717:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+24:18372:x1874709517101312:12345-192.168.202.60@tcp:36:dd.0 Request processed in 897us (3357us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1787863127.638725:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000020:00080000:1.0:1787863127.638731:0:25878:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787863127.641850:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.641885:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.641891:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.641895:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ea00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863127.641900:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.641906:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.641923:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:3.0:1787863127.641925:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787863127.641929:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863127.641933:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931ce6 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863127.828842:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863127.828952:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517101568 00000100:00100000:2.0:1787863127.828964:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517101568 00000100:00100000:2.0:1787863127.829030:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787863127.829079:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18372:x1874709517101568:12345-192.168.202.60@tcp:35:dd.0 00000100:00100000:2.0:1787863127.829354:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+24:18372:x1874709517101568:12345-192.168.202.60@tcp:35:dd.0 Request processed in 314us (538us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1787863127.829362:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787863128.106179:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863128.106575:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517101696 00000100:00100000:0.0:1787863128.106586:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517101696 00000100:00100000:0.0:1787863128.106678:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:0.0:1787863128.106690:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+24:18386:x1874709517101696:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:0.0:1787863128.106722:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863128.106746:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931ced lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e20 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.106828:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.106859:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.106873:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.106893:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.106901:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.106909:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107027:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107036:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107072:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863128.107112:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787863128.107117:0:23752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787863128.107174:0:23752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107187:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107207:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107213:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107220:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107226:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863128.107231:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107238:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107251:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:0.0:1787863128.107254:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863128.107259:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107266:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636200/0x9c5536ccf8931cf4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107280:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107286:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107292:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107304:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863128.107308:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107313:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107321:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a650a0b6f00) 00010000:00010000:0.0:1787863128.107323:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863128.107326:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107332:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931cfb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107366:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf8931ced lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e20 expref: 26 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787863128.107588:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787863128.107642:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e20 expref: 25 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.107651:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863128.107653:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787863128.107656:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031c00, rc 0) 00000100:00100000:0.0:1787863128.107766:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+25:18386:x1874709517101696:12345-192.168.202.60@tcp:101:stat.0 Request processed in 1078us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863128.107774:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:3.0:1787863128.162088:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863128.162200:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517101952 00000100:00100000:2.0:1787863128.162212:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517101952 00000100:00100000:1.0:1787863128.162407:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:1.0:1787863128.162421:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+25:18392:x1874709517101952:12345-192.168.202.60@tcp:36:truncate.0 00010000:00010000:1.0:1787863128.162490:0:25878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863128.162517:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8931d02 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e20 expref: 25 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.162557:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863128.162563:0:25878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787863128.162792:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.162808:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.162820:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787863128.162876:0:25878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1787863128.162903:0:25878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078519758 reply state 00000000e3d0db67 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863128.162913:0:25878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787863128.163109:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+27:18392:x1874709517101952:12345-192.168.202.60@tcp:36:truncate.0 Request processed in 626us (965us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787863128.163117:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000020:00080000:1.0:1787863128.163122:0:25878:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787863128.173651:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.173671:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.173679:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.173686:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863128.173712:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.173721:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.173739:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863128.173743:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787863128.173748:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.173755:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d09 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863128.221064:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787863128.221089:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526539136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863128.221176:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863128.221550:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526539136 00000100:00100000:0.0:1787863128.221572:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526539136 00000100:00100000:0.0:1787863128.221639:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787863128.221651:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402ade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526539136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787863128.221688:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787863128.221735:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402ade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526539136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863128.221742:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787863128.221799:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787863128.221832:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526539136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863128.433581:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863128.433730:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517102080 00000100:00100000:0.0:1787863128.433739:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517102080 00000100:00100000:0.0:1787863128.433798:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:0.0:1787863128.433806:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402ade940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+26:18406:x1874709517102080:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:0.0:1787863128.433834:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863128.433852:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8931d10 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e27 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.433916:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.433930:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.433941:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.433951:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.433955:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.433977:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434079:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434085:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434090:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863128.434118:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787863128.434122:0:23752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787863128.434140:0:23752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434151:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434158:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434163:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434167:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434171:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863128.434175:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434185:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434193:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:0.0:1787863128.434195:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863128.434199:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434203:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d17 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434212:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434216:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434220:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434222:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863128.434224:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434227:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434230:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a650a0b6f00) 00010000:00010000:0.0:1787863128.434232:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863128.434233:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434243:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d1e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434267:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8931d10 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 28 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434275:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 27 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.434280:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863128.434281:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787863128.434283:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787863128.434342:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402ade940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+27:18406:x1874709517102080:12345-192.168.202.60@tcp:101:stat.0 Request processed in 536us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863128.434349:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00010000:00010000:1.0:1787863128.479259:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863128.562999:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863128.563283:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517102336 00000100:00100000:1.0:1787863128.563292:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517102336 00000100:00100000:1.0:1787863128.563360:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787863128.563390:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+27:18416:x1874709517102336:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787863128.563414:0:25878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863128.563445:0:25878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e2e expref: -99 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863128.563579:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787863128.563703:0:25878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e2e expref: 29 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.563718:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:1.0:1787863128.563721:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787863128.563727:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e2e expref: 29 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.563756:0:25878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204fa00, rc 0) 00000100:00100000:1.0:1787863128.563827:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+28:18416:x1874709517102336:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 446us (840us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1787863128.563835:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:3.0:1787863128.575919:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863128.576036:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517102592 00000100:00100000:2.0:1787863128.576071:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517102592 00000100:00100000:2.0:1787863128.576147:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787863128.576159:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651259e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+28:18416:x1874709517102592:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787863128.576825:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651259e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+29:18416:x1874709517102592:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 665us (915us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1787863128.576835:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787863128.650487:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863128.651972:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517102848 00000100:00100000:0.0:1787863128.651992:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517102848 00000100:00100000:0.0:1787863128.652112:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:0.0:1787863128.652124:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+29:18422:x1874709517102848:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787863128.652155:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787863128.652182:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8931d3a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e35 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652305:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652321:0:23752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 30 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652347:0:23752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 30 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652356:0:23752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652400:0:23752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 30 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652417:0:23752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 30 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863128.652443:0:23752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526539264:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787863128.652582:0:23752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 30 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.652593:0:23752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 30 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863128.652603:0:23752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526539392:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787863128.652634:0:23752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651039c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787863128.662201:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863128.662322:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517103104 00000100:00100000:1.0:1787863128.662340:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517103104 00010000:00010000:1.0:1787863128.662413:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 31 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863128.662485:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1787863128.662497:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+31:2349:x1874709517103104:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787863128.662513:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863128.662521:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 31 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.662533:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 31 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.662557:0:23737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863128.662563:0:23737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.662572:0:23737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.662579:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863128.662672:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+31:2349:x1874709517103104:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 178us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863128.662681:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:3.0:1787863128.663075:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863128.663113:0:23739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517102976 00000100:00100000:3.0:1787863128.664248:0:23739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517102976 00010000:00010000:3.0:1787863128.664485:0:23739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 31 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863128.664559:0:23739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1787863128.664571:0:23739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+31:2349:x1874709517102976:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787863128.664948:0:23739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787863128.665197:0:23739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 31 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.665221:0:23739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 31 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.665347:0:23739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:3.0:1787863128.665355:0:23739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.665366:0:23739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.665375:0:23739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.665402:0:23739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863128.665485:0:23739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+31:2349:x1874709517102976:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 914us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863128.665496:0:23739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00010000:00010000:0.0:1787863128.669311:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8931d25 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e27 expref: 30 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863128.669351:0:23752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526539264:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863128.670684:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931c76 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34df6 expref: 29 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863128.670715:0:23752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23752:1874709526539392:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863128.670755:0:23752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.670768:0:23752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.670774:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787863128.670802:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787863128.671522:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8931d3a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 30 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.671552:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 29 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.671564:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863128.671567:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787863128.671572:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031800, rc 0) 00000100:00100000:1.0:1787863128.672815:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+29:18422:x1874709517102848:12345-192.168.202.60@tcp:101:bash.0 Request processed in 20680us (22332us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787863128.672830:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:2.0:1787863128.682199:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863128.682429:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517103360 00000100:00100000:1.0:1787863128.682441:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517103360 00000100:00100000:1.0:1787863128.682531:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1787863128.682544:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+29:18422:x1874709517103360:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:1.0:1787863128.682878:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.682901:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.682916:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787863128.682989:0:25878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1787863128.683015:0:25878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005398a679 reply state 0000000027be0ca1 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863128.683025:0:25878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787863128.683173:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+32:18422:x1874709517103360:12345-192.168.202.60@tcp:36:bash.0 Request processed in 632us (986us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1787863128.683181:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000020:00080000:1.0:1787863128.683186:0:25878:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787863128.687683:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.687709:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.687719:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.687727:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863128.687733:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.687742:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.687769:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863128.687773:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863128.687777:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.687784:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8931d4f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863128.692209:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863128.692583:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517103488 00000100:00100000:1.0:1787863128.692607:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517103488 00000100:00100000:1.0:1787863128.692692:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1787863128.692706:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+31:18422:x1874709517103488:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787863128.692744:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863128.692776:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931d56 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e3c expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.692910:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931d56 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e3c expref: 32 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.692931:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931d56 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e3c expref: 32 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.693229:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:1.0:1787863128.693234:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787863128.693240:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204e800, rc 0) 00000100:00100000:1.0:1787863128.694524:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+32:18422:x1874709517103488:12345-192.168.202.60@tcp:101:bash.0 Request processed in 1807us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863128.694540:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:3.0:1787863128.706744:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863128.706909:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517103616 00000100:00100000:1.0:1787863128.706922:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517103616 00000100:00100000:1.0:1787863128.707006:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:1.0:1787863128.707018:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+32:18422:x1874709517103616:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787863128.707429:0:25878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787863128.707459:0:25878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931d5d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e43 expref: -99 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.707575:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.707593:0:25878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 33 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.707629:0:25878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.707738:0:25878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 33 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863128.707758:0:25878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 33 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863128.707775:0:25878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa443c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25878:1874709526539520:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787863128.707892:0:25878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a64030153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787863128.716442:0:25878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa443c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25878:1874709526539520:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787863128.716496:0:25878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863128.720736:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863128.721882:0:23738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517103744 00000100:00100000:2.0:1787863128.721904:0:23738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517103744 00010000:00010000:2.0:1787863128.722116:0:23738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 34 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863128.722389:0:23738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787863128.722406:0:23738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+34:2348:x1874709517103744:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787863128.722439:0:23738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787863128.722448:0:23738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 34 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863128.722468:0:23738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 34 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863128.722501:0:23738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8931d41 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e35 expref: 34 pid: 23752 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863128.722529:0:23738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:2.0:1787863128.722536:0:23738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863128.722549:0:23738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863128.722558:0:23738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863128.722889:0:23738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787863128.723011:0:23738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+33:2348:x1874709517103744:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 610us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863128.723023:0:23738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00010000:00010000:0.0:1787863128.725528:0:25878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.725553:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863128.725779:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787863128.725785:0:25878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787863128.725842:0:25878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.726565:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf8931d5d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e43 expref: 33 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.726616:0:25878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e43 expref: 32 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.726628:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:0.0:1787863128.726631:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787863128.726636:0:25878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f400, rc 0) 00000100:00100000:0.0:1787863128.726819:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+32:18422:x1874709517103616:12345-192.168.202.60@tcp:101:bash.0 Request processed in 19800us (20086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863128.726832:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:2.0:1787863128.751795:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863128.752307:0:23739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104000 00000100:00100000:3.0:1787863128.752321:0:23739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104000 00000100:00100000:3.0:1787863128.752413:0:23739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1787863128.752440:0:23739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+32:18422:x1874709517104000:12345-192.168.202.60@tcp:103:bash.0 00010000:00010000:3.0:1787863128.752462:0:23739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787863128.752498:0:23739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8931d64 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e43 expref: 32 pid: 25878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.752525:0:23739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931d56 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e3c expref: 31 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.752560:0:23739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a650a0b6100) 00010000:00010000:3.0:1787863128.752575:0:23739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787863128.752664:0:23739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+30:18422:x1874709517104000:12345-192.168.202.60@tcp:103:bash.0 Request processed in 228us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863128.752674:0:23739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1787863128.759228:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863128.765847:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104128 00000100:00100000:0.0:1787863128.766140:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104128 00000100:00100000:3.0:1787863128.766507:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:3.0:1787863128.766526:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+30:18422:x1874709517104128:12345-192.168.202.60@tcp:58:bash.0 00010000:00010000:3.0:1787863128.766817:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.766844:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863128.770199:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787863128.772190:0:23754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787863128.772391:0:23754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787863128.772504:0:23754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787863128.772788:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+30:18422:x1874709517104128:12345-192.168.202.60@tcp:58:bash.0 Request processed in 6256us (13577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863128.772805:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:2.0:1787863128.777748:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863128.777971:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104256 00000100:00100000:3.0:1787863128.777985:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104256 00000100:00100000:3.0:1787863128.778087:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1787863128.778099:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+30:18422:x1874709517104256:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787863128.778127:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863128.778155:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e4a expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.779554:0:23753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.779583:0:23753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 31 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.779624:0:23753:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.779643:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 31 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.779662:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:0.0:1787863128.779682:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787863128.779687:0:23753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 31 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863128.779696:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfca00, rc 0) 00000100:00100000:0.0:1787863128.779801:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+31:18422:x1874709517104256:12345-192.168.202.60@tcp:101:bash.0 Request processed in 1703us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863128.779812:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000001:00080000:0.0:1787863128.846017:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901904 is committed 00000001:00080000:0.0:1787863128.846087:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00080000:0.0:1787863128.846094:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901914 is committed 00000001:00080000:0.0:1787863128.846125:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901893 is committed 00000001:00080000:0.0:1787863128.846148:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000040:00080000:3.0:1787863128.988799:0:23786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787863128.988841:0:23786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787863128.988895:0:23786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787863128.988902:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787863128.989111:0:23786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e43c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23786:1874709526539648:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787863128.989737:0:23786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650a2e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787863129.002449:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.002740:0:23786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e43c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23786:1874709526539648:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787863129.003039:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104384 00000100:00100000:0.0:1787863129.003070:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104384 00000100:00100000:0.0:1787863129.003171:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787863129.003183:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104384:12345-192.168.202.60@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787863129.003306:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104384:12345-192.168.202.60@tcp:900:lhsmtool_posix.0 Request processed in 126us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863129.003315:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787863129.015281:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.015647:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104512 00000100:00100000:3.0:1787863129.015663:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104512 00000100:00100000:3.0:1787863129.015760:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:3.0:1787863129.015773:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104512:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787863129.015836:0:23752:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787863129.016023:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104512:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 251us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863129.016031:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:1.0:1787863129.026726:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863129.029240:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104640 00000100:00100000:0.0:1787863129.029262:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104640 00000100:00100000:0.0:1787863129.029378:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:0.0:1787863129.029393:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104640:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787863129.029526:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.029574:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.029589:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039517:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039546:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039560:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039601:0:25878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039611:0:25878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039618:0:25878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787863129.039677:0:25878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787863129.039683:0:25878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787863129.039705:0:25878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039721:0:25878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039752:0:25878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039759:0:25878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039765:0:25878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863129.039770:0:25878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039779:0:25878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039794:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:0.0:1787863129.039797:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863129.039803:0:25878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039809:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931d79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039828:0:25878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039834:0:25878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039839:0:25878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039845:0:25878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863129.039854:0:25878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039861:0:25878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039869:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a650a0b6f00) 00010000:00010000:0.0:1787863129.039872:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863129.039875:0:25878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039880:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931d80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039896:0:25878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039902:0:25878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039909:0:25878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039914:0:25878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863129.039917:0:25878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.039923:0:25878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.044466:0:25878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:0.0:1787863129.044478:0:25878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863129.044513:0:25878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.044525:0:25878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8931d87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863129.047693:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104640:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 18287us (20969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863129.047709:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:0.0:1787863129.068178:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.068452:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517104896 00000100:00100000:3.0:1787863129.068463:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517104896 00000100:00100000:3.0:1787863129.068545:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1787863129.068558:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+10:18423:x1874709517104896:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787863129.068585:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863129.068611:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931d8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e51 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068716:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068733:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068770:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863129.068783:0:23752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787863129.068949:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068957:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068965:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068971:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787863129.068976:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068983:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.068996:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:3.0:1787863129.068999:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787863129.069005:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.069010:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931d95 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.070403:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931d8e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e51 expref: 12 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.070455:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:3.0:1787863129.070458:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787863129.070464:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931d8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e51 expref: 12 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.070480:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd600, rc 0) 00000100:00100000:3.0:1787863129.070570:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+11:18423:x1874709517104896:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 2013us (2408us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1787863129.070580:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:2.0:1787863129.084300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863129.084444:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517105024 00000100:00100000:0.0:1787863129.084457:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517105024 00000100:00100000:0.0:1787863129.084534:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:0.0:1787863129.084546:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+11:18423:x1874709517105024:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787863129.084592:0:23753:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787863129.084727:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+11:18423:x1874709517105024:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 183us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863129.084734:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:0.0:1787863129.094382:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.094601:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517105280 00000100:00100000:2.0:1787863129.094616:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517105280 00000100:00100000:2.0:1787863129.094688:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:2.0:1787863129.094699:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+11:18423:x1874709517105280:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787863129.094724:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863129.094752:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931da3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e58 expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787863129.095874:0:23754:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:2.0:1787863129.095887:0:23754:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1787863129.095943:0:23754:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1787863129.096342:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931daa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.096362:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931daa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.096391:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931daa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.096485:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931da3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e58 expref: 14 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.096507:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931daa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e58 expref: 13 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.096517:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6c00) 00010000:00010000:2.0:1787863129.096520:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787863129.096524:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17400, rc 0) 00000100:00100000:2.0:1787863129.096610:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517105280:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1912us (2244us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1787863129.096619:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:2.0:1787863129.108527:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863129.108614:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517105536 00000100:00100000:0.0:1787863129.108628:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517105536 00000100:00100000:0.0:1787863129.108702:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1787863129.108715:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517105536:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787863129.108791:0:23753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787863129.108825:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931daa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e58 expref: 13 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.108847:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6c00) 00010000:00010000:0.0:1787863129.108880:0:23753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787863129.108907:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.108921:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.108948:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.108966:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.108974:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.108981:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109512:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109523:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109530:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109536:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863129.109541:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109550:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109570:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:0.0:1787863129.109574:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863129.109579:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109585:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931db8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109597:0:23753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109604:0:23753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109610:0:23753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109615:0:23753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863129.109618:0:23753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109624:0:23753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109632:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x12b9a68f (ffff9a650a0b6f00) 00010000:00010000:0.0:1787863129.109634:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863129.109637:0:23753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.109643:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030600/0x9c5536ccf8931dbf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x12b9a68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863129.109770:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+12:18423:x1874709517105536:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 1057us (1254us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787863129.109779:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:1.0:1787863129.123694:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.129675:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517105664 00000100:00100000:2.0:1787863129.129691:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517105664 00000100:00100000:2.0:1787863129.129839:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:2.0:1787863129.129852:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+12:18423:x1874709517105664:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787863129.129878:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863129.129909:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931dc6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e5f expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.129969:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931dcd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.130004:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931dcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.130016:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931dcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.130148:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931dc6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e5f expref: 14 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.130169:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931dcd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e5f expref: 13 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.130177:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787863129.130180:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787863129.130184:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16a00, rc 0) 00000100:00100000:2.0:1787863129.130280:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517105664:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 431us (6599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.130288:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:1.0:1787863129.149171:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863129.150507:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517105920 00000100:00100000:0.0:1787863129.150525:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517105920 00000100:00100000:0.0:1787863129.150594:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:0.0:1787863129.150606:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517105920:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787863129.150711:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.150730:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.150743:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787863129.151433:0:23753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1787863129.151447:0:23753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 854915403337ns, next at 855915400744ns, rc = 0 00000004:00010000:0.0:1787863129.151553:0:23753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000093b5779 reply state 00000000655d34a1 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863129.151565:0:23753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787863129.151707:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+15:18423:x1874709517105920:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 1101us (2546us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1787863129.151716:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00010000:00010000:1.0:1787863129.156391:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.156410:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.156428:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.156435:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863129.156460:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.156470:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.156490:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787863129.156493:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787863129.156499:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.156505:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030000/0x9c5536ccf8931dd4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863129.159119:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.160078:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517106048 00000100:00100000:3.0:1787863129.160098:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517106048 00000100:00100000:3.0:1787863129.160223:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:3.0:1787863129.160241:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+14:18423:x1874709517106048:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787863129.160289:0:23752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863129.160458:0:23752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e66 expref: -99 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.160554:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 15 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.160570:0:23752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 15 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.160614:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787863129.160617:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787863129.160621:0:23752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16200, rc 0) 00000100:00100000:2.0:1787863129.160703:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+15:18423:x1874709517106048:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 466us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.160712:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:1.0:1787863129.163683:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.163830:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517106176 00000100:00100000:3.0:1787863129.163845:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517106176 00000100:00100000:3.0:1787863129.164105:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00080000:0.0:1787863129.164260:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787863129.164383:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2348:x1874709517106176:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787863129.165029:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2348:x1874709517106176:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 910us (1362us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787863129.165083:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787863129.169205:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.170076:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517106432 00000100:00100000:2.0:1787863129.170094:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517106432 00000100:00100000:2.0:1787863129.170537:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787863129.170554:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+15:18423:x1874709517106432:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787863129.171153:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+16:18423:x1874709517106432:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 602us (2033us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787863129.171164:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787863129.174538:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863129.174726:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517106688 00000100:00100000:0.0:1787863129.174740:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517106688 00000100:00100000:0.0:1787863129.174844:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:0.0:1787863129.174866:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+16:18423:x1874709517106688:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787863129.175092:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+16:18423:x1874709517106688:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 228us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863129.175102:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:2.0:1787863129.181849:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.182009:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517106816 00000100:00100000:3.0:1787863129.182024:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517106816 00000100:00100000:3.0:1787863129.182121:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:3.0:1787863129.182144:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+16:18423:x1874709517106816:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787863129.182195:0:23754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863129.182485:0:23754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931de2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e6d expref: -99 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.182611:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931de9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.182637:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931de9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.182652:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931de9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863129.182708:0:23754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787863129.182736:0:23754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931de9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.182775:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd600/0x9c5536ccf8931de2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e6d expref: 18 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.182804:0:23754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931de9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e6d expref: 17 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.182814:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:3.0:1787863129.182818:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787863129.182823:0:23754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:3.0:1787863129.183540:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18423:x1874709517106816:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1394us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863129.183553:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:3.0:1787863129.187674:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.187828:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517106944 00000100:00100000:2.0:1787863129.187843:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517106944 00000100:00100000:2.0:1787863129.188006:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1787863129.188020:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2348:x1874709517106944:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787863129.188088:0:24436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863129.188395:0:24436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e74 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787863129.188444:0:24436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a059, blocks: 0x1 00010000:00010000:2.0:1787863129.188494:0:24436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=854s v=(0 0) 00010000:00010000:2.0:1787863129.188500:0:24436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787863129.188515:0:24436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 7 pid: 24436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.188541:0:24436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 7 pid: 24436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.188560:0:24436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17c00, rc 0) 00000100:00100000:2.0:1787863129.188711:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2348:x1874709517106944:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 692us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.188719:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787863129.197725:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863129.197825:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517107200 00000100:00100000:1.0:1787863129.197839:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517107200 00000100:00100000:1.0:1787863129.197942:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:1.0:1787863129.197955:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18423:x1874709517107200:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787863129.199458:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18423:x1874709517107200:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 1492us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863129.199475:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:2.0:1787863129.204777:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863129.205675:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517107328 00000100:00100000:0.0:1787863129.205691:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517107328 00000100:00100000:0.0:1787863129.205784:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1787863129.205797:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18423:x1874709517107328:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787863129.270819:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901917 is committed 00000004:00080000:0.0:1787863129.270841:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787863129.270873:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000100:00100000:0.0:1787863129.271082:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517107328:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 65280us (66312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787863129.271095:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:2.0:1787863129.271383:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526539776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787863129.271468:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787863129.272360:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526539776 00000100:00100000:3.0:1787863129.272373:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526539776 00000100:00100000:3.0:1787863129.272453:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787863129.272465:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526539776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787863129.272786:0:24437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787863129.272791:0:24437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787863129.272793:0:24437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787863129.272796:0:24437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1787863129 -> 1787863129 00002000:00010000:3.0:1787863129.272798:0:24437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787863129.272868:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526539776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 405us (1399us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1787863129.272877:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787863129.272948:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a651fc8b0c0/2, rc 0, transno 12884901891 00000100:00100000:3.0:1787863129.272955:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526539776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787863129.276552:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863129.276647:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517107456 00000100:00100000:1.0:1787863129.276671:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517107456 00000100:00100000:1.0:1787863129.276751:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787863129.276764:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2348:x1874709517107456:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787863129.276933:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2348:x1874709517107456:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 170us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863129.276958:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787863129.292238:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.292334:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517107712 00000100:00100000:2.0:1787863129.292351:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517107712 00000100:00100000:2.0:1787863129.292444:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:2.0:1787863129.292456:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517107712:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787863129.292540:0:23753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787863129.292581:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931de9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e6d expref: 13 pid: 23754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.292610:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787863129.292617:0:23753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787863129.292676:0:23753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.292706:0:23753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.292718:0:23753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787863129.292985:0:23753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004944f2e7 reply state 0000000017532283 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863129.292997:0:23753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787863129.293165:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+14:18423:x1874709517107712:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 710us (941us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1787863129.293174:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00010000:00010000:0.0:1787863129.301412:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.301447:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.301455:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.301462:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787863129.301469:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.301478:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.301516:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:0.0:1787863129.301520:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787863129.301526:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.301532:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931df7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787863129.302492:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.304000:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517107840 00000100:00100000:3.0:1787863129.304021:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517107840 00000100:00100000:3.0:1787863129.304484:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:3.0:1787863129.304499:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+7:18423:x1874709517107840:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787863129.304528:0:24436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787863129.304560:0:24436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e7b expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.304601:0:24436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 8 pid: 24436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.304637:0:24436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787863129.304643:0:24436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787863129.304650:0:24436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.304710:0:24436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 8 pid: 24436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.304730:0:24436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 8 pid: 24436 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863129.304750:0:24436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24436:1874709526539904:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787863129.304905:0:24436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787863129.311166:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.311205:0:23738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517107968 00000100:00100000:2.0:1787863129.311219:0:23738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517107968 00010000:00010000:2.0:1787863129.311281:0:23738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 9 pid: 24436 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863129.311329:0:23738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1787863129.311341:0:23738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+9:2348:x1874709517107968:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787863129.311363:0:23738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787863129.311396:0:23738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 9 pid: 24436 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.311428:0:23738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 9 pid: 24436 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.311486:0:23738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787863129.311492:0:23738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787863129.311500:0:23738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 9 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.311512:0:23738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 9 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.311569:0:23738:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 9 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863129.311588:0:23738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc8a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:23738:1874709526540032:192.168.202.60@tcp:105: 00000100:00100000:2.0:1787863129.311715:0:23738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6511368000 going to sleep for 11 seconds 00010000:00010000:2.0:1787863129.314790:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e835ce/0x9c5536ccf8931df0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e74 expref: 9 pid: 24436 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863129.314829:0:24436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24436:1874709526539904:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787863129.314876:0:24436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.314897:0:24436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd600, rc 0) 00000100:00100000:2.0:1787863129.315012:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+8:18423:x1874709517107840:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 10516us (12528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.315070:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:0.0:1787863129.323009:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863129.323700:0:23738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc8a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:23738:1874709526540032:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787863129.323736:0:23738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863129.323809:0:23738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2348:x1874709517107968:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 12469us (12661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863129.323824:0:23738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787863129.325602:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517108096 00000100:00100000:3.0:1787863129.325628:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517108096 00000100:00100000:3.0:1787863129.325731:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787863129.325746:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2349:x1874709517108096:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787863129.326094:0:24437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787863129.326099:0:24437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1787863128 00002000:00010000:3.0:1787863129.326102:0:24437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1787863126 00002000:00010000:3.0:1787863129.326105:0:24437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1787863129 -> 1787863128 00002000:00010000:3.0:1787863129.326107:0:24437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787863129.329666:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+8:2349:x1874709517108096:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 3902us (6653us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787863129.329730:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:0.0:1787863129.334835:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.335015:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517108224 00000100:00100000:2.0:1787863129.335030:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517108224 00000100:00100000:2.0:1787863129.335141:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:2.0:1787863129.335155:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+8:2348:x1874709517108224:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787863129.335229:0:24436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.335258:0:24436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.335269:0:24436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787863129.335275:0:24436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787863129.335280:0:24436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.335331:0:24436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.335350:0:24436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863129.335369:0:24436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc8a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24436:1874709526540160:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787863129.335495:0:24436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6511368e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787863129.339304:0:24436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc8a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24436:1874709526540160:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787863129.339381:0:24436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787863129.346203:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000100:00100000:0.0:1787863129.347228:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863129.347349:0:23737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517108352 00000100:00100000:1.0:1787863129.347364:0:23737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517108352 00010000:00010000:1.0:1787863129.347435:0:23737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863129.347540:0:23737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787863129.347555:0:23737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+8:2348:x1874709517108352:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787863129.347577:0:23737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863129.347611:0:23737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.347633:0:23737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.347683:0:23737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004aee1cfe/0x9c5536ccf8931dfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e7b expref: 8 pid: 24436 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.347738:0:23737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787863129.347743:0:23737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787863129.347751:0:23737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.347763:0:23737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.347807:0:23737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787863129.348100:0:24436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348124:0:24436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348160:0:24436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348170:0:24436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348180:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348189:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787863129.348196:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348206:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348222:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.348243:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863129.348404:0:23737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2348:x1874709517108352:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 850us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863129.348430:0:23737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787863129.349381:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+6:2348:x1874709517108224:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 14220us (14552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.349403:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:0.0:1787863129.352127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.353402:0:23754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517108608 00000100:00100000:3.0:1787863129.353431:0:23754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517108608 00000100:00100000:3.0:1787863129.353553:0:23754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:3.0:1787863129.353569:0:23754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+13:18423:x1874709517108608:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787863129.353733:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.353763:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.353783:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.355478:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.355525:0:23754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 14 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.355537:0:23754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.355601:0:23754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 14 pid: 23752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.355625:0:23754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 14 pid: 23752 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787863129.355679:0:23754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23754:1874709526540288:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787863129.355817:0:23754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65081d8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787863129.369812:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.369985:0:23754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23754:1874709526540288:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787863129.370021:0:23754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863129.370120:0:23738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517108736 00000100:00100000:1.0:1787863129.370129:0:23738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517108736 00010000:00010000:1.0:1787863129.370183:0:23738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 15 pid: 23752 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863129.370226:0:23738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787863129.370237:0:23738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+15:2349:x1874709517108736:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787863129.370256:0:23738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787863129.370263:0:23738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 15 pid: 23752 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.370279:0:23738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 15 pid: 23752 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.370333:0:23738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931ddb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e66 expref: 15 pid: 23752 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.370353:0:23738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787863129.370358:0:23738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.370370:0:23738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.370379:0:23738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.370410:0:23738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787863129.370483:0:23738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+14:2349:x1874709517108736:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 248us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863129.370492:0:23738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00010000:00010000:0.0:1787863129.371281:0:23754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787863129.371293:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787863129.371589:0:23754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1787863129.371756:0:23754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1787863129.371803:0:23754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1787863129.372184:0:23754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23754:1874709526540416:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787863129.374026:0:23754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863129.374101:0:23754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787863129.374199:0:23757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526540416 00000100:00100000:3.0:1787863129.374219:0:23757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526540416 00000100:00100000:3.0:1787863129.374307:0:23757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787863129.374322:0:23757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23754:x1874709526540416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787863129.374512:0:23757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23754:x1874709526540416:12345-0@lo:1000:mdt00_002.0 Request processed in 192us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863129.374522:0:23757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787863129.374567:0:23754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23754:1874709526540416:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787863129.376196:0:23754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1787863129.376556:0:23754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23754:1874709526540544:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787863129.376953:0:23754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787863129.377005:0:23754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787863129.377636:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526540544 00000100:00100000:3.0:1787863129.377663:0:23758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526540544 00000100:00100000:3.0:1787863129.377767:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787863129.377778:0:23758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23754:x1874709526540544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787863129.378190:0:23758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:23754:x1874709526540544:12345-0@lo:1000:mdt00_002.0 Request processed in 411us (1236us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787863129.378200:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787863129.378503:0:23754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23754:1874709526540544:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787863129.378571:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378583:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378592:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378599:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863129.378604:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378623:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378645:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787863129.378649:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787863129.378655:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378663:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e13 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378708:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378715:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378721:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378726:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863129.378730:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378736:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378744:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:1.0:1787863129.378746:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787863129.378755:0:23754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 17 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378780:0:23754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 17 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378792:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 17 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.378873:0:23754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931d72 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e4a expref: 17 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787863129.378890:0:23754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23754:1874709526540672:192.168.202.60@tcp:105: 00000100:00100000:1.0:1787863129.379784:0:23754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6403015540 going to sleep for 11 seconds 00000100:00100000:1.0:1787863129.384287:0:23754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23754:1874709526540672:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787863129.384335:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384349:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931d6b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384396:0:23754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384424:0:23754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384439:0:23754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384450:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384479:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384486:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384492:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204e800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863129.384497:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384505:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384520:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:1.0:1787863129.384523:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787863129.384527:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384533:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf8931e1a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384544:0:23754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384549:0:23754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384555:0:23754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384559:0:23754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787863129.384569:0:23754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384575:0:23754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384582:0:23754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:1.0:1787863129.384584:0:23754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787863129.384587:0:23754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.384593:0:23754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931e0c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787863129.385541:0:23786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787863129.385552:0:23786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787863129.385586:0:23786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787863129.385596:0:23786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787863129.385792:0:23754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+17:18423:x1874709517108608:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 32217us (33686us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1787863129.385809:0:23754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000020:00080000:0.0:1787863129.385816:0:23754:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787863129.394262:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863129.394325:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.394512:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517108992 00000100:00100000:3.0:1787863129.394551:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517108992 00000100:00100000:3.0:1787863129.394624:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517109120 00000100:00100000:3.0:1787863129.394628:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517109120 00000100:00100000:3.0:1787863129.394651:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1787863129.394662:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+18:18423:x1874709517108992:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787863129.395959:0:23756:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787863129.396354:0:23756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:3.0:1787863129.396439:0:23756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.396466:0:23756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.396482:0:23756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.396492:0:23756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.396500:0:23756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.396509:0:23756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.396543:0:23756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787863129.396691:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+20:18423:x1874709517108992:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 2024us (2443us total) trans 12884901926 rc 0/0 00000100:00100000:3.0:1787863129.396704:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000020:00080000:3.0:1787863129.396712:0:23756:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787863129.396752:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:3.0:1787863129.396774:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+19:18422:x1874709517109120:12345-192.168.202.60@tcp:49:bash.0 00000100:00100000:3.0:1787863129.396889:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+19:18422:x1874709517109120:12345-192.168.202.60@tcp:49:bash.0 Request processed in 122us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863129.396896:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00010000:00010000:1.0:1787863129.397526:0:25864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787863129.397538:0:25864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.397549:0:25864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787863129.397554:0:25864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.397564:0:25864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.397587:0:25864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787863129.397590:0:25864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787863129.397598:0:25864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.397619:0:25864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931e21 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787863129.397638:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863129.397640:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787863129.397642:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787863129.401202:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.401383:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517109248 00000100:00100000:2.0:1787863129.401398:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517109248 00000100:00100000:2.0:1787863129.401504:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787863129.401518:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+6:18422:x1874709517109248:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787863129.401547:0:24435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863129.401578:0:24435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e82 expref: -99 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787863129.401618:0:24435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a90a058, atime: 0x6a90a056, ctime: 0x6a90a058, blocks: 0x1 00010000:00010000:2.0:1787863129.401653:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=855s v=(0 0) 00010000:00010000:2.0:1787863129.401660:0:24435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787863129.401687:0:24435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e82 expref: 7 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.401708:0:24435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d384790/0x9c5536ccf8931e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e82 expref: 7 pid: 24435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.401726:0:24435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16600, rc 0) 00000100:00100000:2.0:1787863129.402486:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:18422:x1874709517109248:12345-192.168.202.60@tcp:101:bash.0 Request processed in 965us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.402497:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787863129.405847:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.406003:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517109504 00000100:00100000:3.0:1787863129.406016:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517109504 00000100:00100000:3.0:1787863129.406128:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787863129.406140:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+19:18422:x1874709517109504:12345-192.168.202.60@tcp:35:bash.0 00000001:00080000:3.0:1787863129.406529:0:23756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1787863129.406642:0:23756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1787863129.406772:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+22:18422:x1874709517109504:12345-192.168.202.60@tcp:35:bash.0 Request processed in 632us (938us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1787863129.406782:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000020:00080000:3.0:1787863129.406788:0:23756:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787863129.494133:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.494424:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517109760 00000100:00100000:2.0:1787863129.494443:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517109760 00000100:00100000:2.0:1787863129.494536:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:2.0:1787863129.494550:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+22:18433:x1874709517109760:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787863129.494593:0:23753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787863129.494625:0:23753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17c00/0x9c5536ccf8931e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34e89 expref: -99 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787863129.496095:0:23753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787863129.496510:0:23753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17c00/0x9c5536ccf8931e2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e89 expref: 24 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.496535:0:23753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507ee2500) 00010000:00010000:3.0:1787863129.496539:0:23753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787863129.496546:0:23753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17c00/0x9c5536ccf8931e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34e89 expref: 24 pid: 23753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787863129.496568:0:23753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17c00, rc 0) 00000100:00100000:3.0:1787863129.496698:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18433:x1874709517109760:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 2148us (2653us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1787863129.496724:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00010000:00010000:0.0:1787863129.500523:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787863129.502208:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863129.502576:0:23752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517109888 00000100:00100000:2.0:1787863129.502593:0:23752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517109888 00000100:00100000:2.0:1787863129.502713:0:23752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:2.0:1787863129.502730:0:23752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18433:x1874709517109888:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:2.0:1787863129.502875:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.502901:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.502916:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.502939:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.502947:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.502981:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503673:0:23752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503687:0:23752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503698:0:23752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787863129.503763:0:23752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503782:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503789:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503798:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503805:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863129.503811:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503820:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503837:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a6507ee2e00) 00010000:00010000:2.0:1787863129.503847:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863129.503855:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503862:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17400/0x9c5536ccf8931e3d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503883:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503889:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503896:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503902:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863129.503905:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503912:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503921:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a6507fe6000) 00010000:00010000:2.0:1787863129.503924:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863129.503927:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503934:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931e44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503954:0:23752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503967:0:23752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503973:0:23752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503978:0:23752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787863129.503982:0:23752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503988:0:23752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.503997:0:23752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a6517c53600) 00010000:00010000:2.0:1787863129.504001:0:23752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787863129.504004:0:23752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787863129.504010:0:23752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf8931e4b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787863129.505200:0:23752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18433:x1874709517109888:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 2459us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863129.505219:0:23752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:2.0:1787863129.508939:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787863129.509312:0:23756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110144 00000100:00100000:3.0:1787863129.509328:0:23756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110144 00000100:00100000:3.0:1787863129.509441:0:23756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1787863129.509455:0:23756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+23:18433:x1874709517110144:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787863129.510378:0:23756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+24:18433:x1874709517110144:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 921us (1522us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1787863129.510390:0:23756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00010000:00010000:3.0:1787863130.530436:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787863131.512999:0:25920:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787863131.552984:0:25864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787863131.804501:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d17b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526541056:0@lo:400:kworker.0 00000100:00100000:2.0:1787863131.804580:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863131.804986:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d178780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526540800:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805027:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863131.805072:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d17b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526541312:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805100:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863131.805121:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787863131.805126:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d178b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526541184:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805147:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863131.805179:0:23745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526540800 00000100:00100000:1.0:1787863131.805187:0:23745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526540800 00000100:00100000:1.0:1787863131.805233:0:23745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787863131.805243:0:23745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3282:x1874709526540800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805299:0:23745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38779eb7-76b5-435e-9dc5-da8e02f86cb2+19:3282:x1874709526540800:12345-0@lo:400:kworker.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.805306:0:23745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787863131.805339:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526541312 00000100:00100000:1.0:1787863131.805343:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526541312 00000100:00100000:1.0:1787863131.805376:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526541184 00000100:00100000:1.0:1787863131.805380:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526541184 00000100:00100000:1.0:1787863131.805444:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787863131.805451:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526541312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805500:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526541312:12345-0@lo:400:kworker.0 Request processed in 49us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.805508:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787863131.805520:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787863131.805526:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526541184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805551:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526541184:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.805556:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787863131.805575:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787863131.805607:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d178b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526541184:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805617:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d178780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38779eb7-76b5-435e-9dc5-da8e02f86cb2:3282:1874709526540800:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805625:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d17b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526541312:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805683:0:24436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526541056 00000100:00100000:1.0:1787863131.805687:0:24436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526541056 00000100:00100000:1.0:1787863131.805719:0:24436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787863131.805726:0:24436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d179680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526541056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.805759:0:24436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d179680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526541056:12345-0@lo:400:kworker.0 Request processed in 34us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.805765:0:24436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787863131.805782:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787863131.806007:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787863131.806023:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d178f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526540928:0@lo:400:kworker.0 00000100:00100000:2.0:1787863131.806080:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863131.806099:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d1783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526541440:0@lo:400:kworker.0 00000100:00100000:2.0:1787863131.806121:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863131.806144:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d17b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526541056:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.806618:0:24435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526540928 00000100:00100000:1.0:1787863131.806624:0:24435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526540928 00000100:00100000:1.0:1787863131.806668:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787863131.806675:0:24435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d1792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1874709526540928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.806723:0:24435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d1792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1874709526540928:12345-0@lo:400:kworker.0 Request processed in 48us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.806738:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787863131.806757:0:25878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526541440 00000100:00100000:1.0:1787863131.806761:0:25878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526541440 00000100:00100000:1.0:1787863131.806786:0:25878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787863131.806793:0:25878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d17a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526541440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.806824:0:25878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d17a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526541440:12345-0@lo:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.806846:0:25878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787863131.806878:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d178f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526540928:0@lo:400:kworker.0 00000100:00100000:1.0:1787863131.806893:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d1783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526541440:0@lo:400:kworker.0 00000100:00080000:0.0:1787863131.808572:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787863131.808584:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787863131.808818:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526541568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787863131.808890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787863131.809126:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526541568 00000100:00100000:2.0:1787863131.809134:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526541568 00000100:00100000:2.0:1787863131.809188:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787863131.809197:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526541568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787863131.809238:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787863131.809299:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526541568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863131.809306:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787863131.809407:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526541568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787863131.856986:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863131.857038:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863131.857116:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863131.857145:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863131.857159:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863131.857172:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787863131.857210:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787863131.857336:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110784 00000100:00100000:2.0:1787863131.857346:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110784 00000100:00100000:2.0:1787863131.857432:0:23753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110400 00000100:00100000:2.0:1787863131.857435:0:23753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110400 00000100:00100000:2.0:1787863131.857459:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:2.0:1787863131.857469:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517110784:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863131.857549:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e8602b08-1200-4083-9eda-e1ca27e3ef35+6:2349:x1874709517110784:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 81us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863131.857556:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:2.0:1787863131.857573:0:23753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:2.0:1787863131.857579:0:23753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+24:2349:x1874709517110400:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787863131.857602:0:23753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfe61ff8-722b-424a-b548-843f4f74cf11+24:2349:x1874709517110400:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787863131.857620:0:23753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787863131.858022:0:23747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110272 00000100:00100000:3.0:1787863131.858028:0:23747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110272 00000100:00100000:3.0:1787863131.858100:0:23747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:3.0:1787863131.858108:0:23747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654009cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+13:2349:x1874709517110272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787863131.858150:0:23747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654009cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b170930b-71af-4df4-aeea-8cf989f3465f+13:2349:x1874709517110272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 43us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787863131.858156:0:23747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:1.0:1787863131.858414:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110528 00000100:00100000:1.0:1787863131.858419:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110528 00000100:00100000:1.0:1787863131.858457:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517111040 00000100:00100000:1.0:1787863131.858460:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517111040 00000100:00100000:1.0:1787863131.858474:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110656 00000100:00100000:1.0:1787863131.858476:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110656 00000100:00100000:1.0:1787863131.858488:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517110912 00000100:00100000:1.0:1787863131.858491:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517110912 00000100:00100000:1.0:1787863131.858505:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:1.0:1787863131.858511:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2349:x1874709517110528:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863131.858553:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2349:x1874709517110528:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 42us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.858559:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:1.0:1787863131.858572:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787863131.858587:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517111040:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863131.858611:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517111040:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.858616:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787863131.858627:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787863131.858631:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517110656:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863131.858650:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+5:2349:x1874709517110656:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 19us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.858656:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787863131.858665:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:1.0:1787863131.858670:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517110912:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787863131.858687:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e8602b08-1200-4083-9eda-e1ca27e3ef35+5:2349:x1874709517110912:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 17us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863131.858691:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00080000:0.0:1787863131.859439:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787863131.859446:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787863131.859449:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787863132.574463:0:23741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787863132.893405:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863132.893453:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787863132.893484:0:24437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517111296 00000100:00100000:1.0:1787863132.893497:0:24437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517111296 00000100:00100000:1.0:1787863132.893558:0:24437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:1.0:1787863132.893568:0:24437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2346:x1874709517111296:12345-192.168.202.60@tcp:16:kworker.0 00000100:00100000:1.0:1787863132.893690:0:24437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2346:x1874709517111296:12345-192.168.202.60@tcp:16:kworker.0 Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863132.893697:0:24437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:3.0:1787863132.894353:0:24440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517111168 00000100:00100000:3.0:1787863132.894360:0:24440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517111168 00002000:00100000:3.0:1787863132.894403:0:24440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9a6401b3fc00 x1874709517111168/t0(0) o4->dfe61ff8-722b-424a-b548-843f4f74cf11@192.168.202.60@tcp:493/0 lens 504/0 e 0 to 0 dl 1787863143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787863132.894414:0:24440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6401b3fc00 with x1874709517111168 ext(0->8) 00002000:00010000:3.0:1787863132.894420:0:24440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6401b3fc00 00000100:00100000:3.0:1787863132.894438:0:24440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:3.0:1787863132.894457:0:24440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+7:2346:x1874709517111168:12345-192.168.202.60@tcp:4:bash.0 00000100:00100000:3.0:1787863132.894927:0:24440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dfe61ff8-722b-424a-b548-843f4f74cf11+9:2346:x1874709517111168:12345-192.168.202.60@tcp:4:bash.0 Request processed in 470us (1472us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787863132.894935:0:24440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00002000:00100000:3.0:1787863132.894943:0:24440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9a6401b3fc00 x1874709517111168/t12884901894(0) o4->dfe61ff8-722b-424a-b548-843f4f74cf11@192.168.202.60@tcp:493/0 lens 504/448 e 0 to 0 dl 1787863143 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787863132.894951:0:24440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6401b3fc00 with x1874709517111168 ext(0->8) 00002000:00010000:3.0:1787863132.895946:0:24440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6401b3fc00 00000100:00100000:3.0:1787863133.344487:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526541696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787863133.344584:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787863133.357488:0:24438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526541696 00000100:00100000:1.0:1787863133.357526:0:24438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526541696 00000100:00100000:1.0:1787863133.357614:0:24438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787863133.357626:0:24438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874709526541696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787863133.357656:0:24438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787863133.357754:0:24438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874709526541696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (13171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787863133.357761:0:24438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787863133.357791:0:23748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787863133.357843:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526541696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787863133.596347:0:23740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 10245 lines, 10245 kept, 0 dropped, 0 bad.