00000100:00100000:0.0F:1789498865.643361:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98772aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498865.643451:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1789498865.644219:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689088 00000100:00100000:1.0:1789498865.644235:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689088 00000100:00100000:1.0:1789498865.644298:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789498865.644308:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885689088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498865.644346:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498865.644393:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885689088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498865.644400:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789498865.644428:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885689344:0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.644458:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498865.644480:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498865.644486:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885689472:0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.648132:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789498865.648262:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498865.648289:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689344 00000100:00100000:1.0:1789498865.648298:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689344 00000100:00100000:1.0:1789498865.648357:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789498865.648367:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885689344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.648441:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885689344:12345-0@lo:400:kworker.0 Request processed in 76us (3982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498865.648449:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789498865.648471:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689472 00000100:00100000:1.0:1789498865.648475:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689472 00000100:00100000:1.0:1789498865.648502:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789498865.648519:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885689472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.648561:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885689472:12345-0@lo:400:kworker.0 Request processed in 53us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498865.648566:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789498865.648610:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885689216:0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.648651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498865.648693:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885689728:0@lo:400:kworker.0 00000100:00080000:0.0:1789498865.649671:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498865.649690:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885689600:0@lo:400:kworker.0 00000100:00100000:0.0:1789498865.649725:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498865.649785:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98772aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498865.649829:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885689472:0@lo:400:kworker.0 00000100:00100000:0.0:1789498865.649841:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885689344:0@lo:400:kworker.0 00000100:00100000:0.0:1789498865.649879:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689216 00000100:00100000:0.0:1789498865.649884:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689216 00000100:00100000:0.0:1789498865.649918:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789498865.649924:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885689216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498865.649960:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3306:x1876424885689216:12345-0@lo:400:kworker.0 Request processed in 36us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498865.649961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498865.649967:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789498865.649988:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1cf59db6-3bc5-4ded-8751-c46e361eaced:3306:1876424885689216:0@lo:400:kworker.0 00000100:00100000:0.0:1789498865.650003:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689600 00000100:00100000:0.0:1789498865.650006:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689600 00000100:00100000:0.0:1789498865.650037:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689728 00000100:00100000:0.0:1789498865.650040:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689728 00000100:00100000:0.0:1789498865.650058:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789498865.650064:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e987729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885689600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.650082:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789498865.650104:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498865.650121:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e987729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885689600:12345-0@lo:400:kworker.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498865.650128:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789498865.650136:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885689728:12345-0@lo:400:kworker.0 Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498865.650142:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:0.0:1789498865.650153:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498865.650165:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885689600:0@lo:400:kworker.0 00000100:00100000:1.0:1789498865.650176:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885689728:0@lo:400:kworker.0 00010000:00010000:1.0:1789498866.092161:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1789498867.115308:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1789498867.184444:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498867.184490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885689856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498867.184592:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498867.184678:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689856 00000100:00100000:3.0:1789498867.184689:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689856 00000100:00100000:3.0:1789498867.184770:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789498867.184781:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885689856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498867.184832:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498867.184889:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885689856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498867.184897:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789498867.184959:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea8535f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885689856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789498867.185974:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789498868.157677:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498869.080619:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498869.080658:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731392 00000100:00100000:0.0:1789498869.080668:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731392 00000100:00100000:0.0:1789498869.080730:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:0.0:1789498869.080741:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14405:x1876424864731392:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789498869.080849:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14405:x1876424864731392:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498869.080856:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00080000:0.0:1789498869.080877:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498869.092080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498869.094504:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731648 00000100:00100000:0.0:1789498869.094520:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731648 00000100:00100000:0.0:1789498869.094576:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1789498869.094586:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:14405:x1876424864731648:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789498869.094883:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:14405:x1876424864731648:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 298us (2811us total) trans 8589934672 rc 0/0 00000100:00100000:0.0:1789498869.094891:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1789498869.145020:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498869.145067:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498869.145130:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498869.145165:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732032 00000100:00100000:2.0:1789498869.145175:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732032 00000100:00100000:2.0:1789498869.145237:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:2.0:1789498869.145249:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864732032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498869.145338:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864732032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.145347:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:2.0:1789498869.145374:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731904 00000100:00100000:2.0:1789498869.145378:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731904 00000100:00100000:2.0:1789498869.145407:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:2.0:1789498869.145413:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864731904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498869.145440:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864731904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.145446:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00080000:2.0:1789498869.145463:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498869.145478:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498869.145675:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864731776 00000100:00100000:0.0:1789498869.145680:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864731776 00000100:00100000:0.0:1789498869.145720:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 206 00000100:00100000:0.0:1789498869.145727:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864731776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498869.145769:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864731776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498869.145775:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 206 00010000:00010000:1.0:1789498869.164333:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789498869.320557:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934672 is committed 00010000:00010000:0.0:1789498870.188835:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498870.263588:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498870.263604:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498870.264181:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1789498870.264195:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789498870.763490:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885690240:0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.763598:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498870.763675:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789498870.763682:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885690112:0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.763708:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498870.763727:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885690624:0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.763755:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498870.763793:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690240 00000100:00100000:1.0:1789498870.763804:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690240 00000100:00100000:1.0:1789498870.763875:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690112 00000100:00100000:1.0:1789498870.763878:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690112 00000100:00100000:1.0:1789498870.763923:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789498870.763939:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885690240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.764005:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885690240:12345-0@lo:400:kworker.0 Request processed in 66us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498870.764012:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789498870.764031:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789498870.764038:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885690112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.764066:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885690112:12345-0@lo:400:kworker.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498870.764072:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789498870.764150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885690112:0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.764161:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885690240:0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.764213:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690624 00000100:00100000:1.0:1789498870.764217:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690624 00000100:00100000:1.0:1789498870.764249:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789498870.764256:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885690624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.764292:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876424885690624:12345-0@lo:400:kworker.0 Request processed in 37us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498870.764298:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789498870.764324:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876424885690624:0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.765455:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885689984:0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.765557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498870.765618:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885690496:0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.765653:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498870.765690:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498870.765697:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885690368:0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.765726:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498870.765883:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690496 00000100:00100000:3.0:1789498870.765894:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690496 00000100:00100000:3.0:1789498870.765965:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690368 00000100:00100000:3.0:1789498870.765969:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690368 00000100:00100000:3.0:1789498870.765995:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789498870.766005:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885690496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.766084:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885690496:12345-0@lo:400:kworker.0 Request processed in 80us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498870.766141:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789498870.766161:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789498870.766167:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885690368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.766198:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885690368:12345-0@lo:400:kworker.0 Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498870.766204:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789498870.766259:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885690368:0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.766270:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885690496:0@lo:400:kworker.0 00000100:00080000:2.0:1789498870.766758:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498870.766768:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498870.766772:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498870.768200:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885689984 00000100:00100000:1.0:1789498870.768217:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885689984 00000100:00100000:1.0:1789498870.768311:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789498870.768324:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885689984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498870.769130:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885689984:0@lo:400:kworker.0 00000100:00100000:1.0:1789498870.769595:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885689984:12345-0@lo:400:kworker.0 Request processed in 119us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498870.769614:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789498870.781375:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885690752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498870.781507:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498870.781607:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690752 00000100:00100000:2.0:1789498870.781620:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690752 00000100:00100000:2.0:1789498870.781703:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789498870.781714:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885690752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498870.781791:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498870.787759:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885690752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6023us (6229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498870.787782:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789498870.788696:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea83f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885690752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789498871.212284:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498872.239216:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498872.301860:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498872.301907:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885690880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498872.302072:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498872.302212:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885690880 00000100:00100000:1.0:1789498872.302226:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885690880 00000100:00100000:1.0:1789498872.302329:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789498872.302341:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885690880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498872.302423:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498872.304763:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885690880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2408us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498872.304785:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789498872.304838:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498872.305623:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885690880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498873.260376:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498874.272681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498874.272729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498874.272772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498874.272808:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498874.272851:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732160 00000100:00100000:3.0:1789498874.272876:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732160 00000100:00100000:3.0:1789498874.272949:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 208 00000100:00100000:3.0:1789498874.272960:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864732160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498874.273304:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2357:x1876424864732160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 343us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498874.273313:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 208 00000100:00100000:3.0:1789498874.273360:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732416 00000100:00100000:3.0:1789498874.277159:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732416 00000100:00100000:3.0:1789498874.277330:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:3.0:1789498874.277345:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864732416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498874.277471:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2357:x1876424864732416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 129us (4661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498874.277480:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00080000:3.0:1789498874.277698:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498874.278108:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732288 00000100:00100000:2.0:1789498874.278118:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732288 00000100:00100000:2.0:1789498874.278172:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732544 00000100:00100000:2.0:1789498874.278176:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732544 00000100:00100000:2.0:1789498874.278201:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:2.0:1789498874.278209:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864732288:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498874.278273:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2357:x1876424864732288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (5606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498874.278280:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:2.0:1789498874.278297:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 239 00000100:00100000:2.0:1789498874.278304:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864732544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498874.278333:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea83f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2357:x1876424864732544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (5604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498874.278339:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 239 00000100:00080000:3.0:1789498874.280928:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789498874.283288:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498875.307375:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498875.897234:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498875.897259:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98e98772b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885691008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498875.901543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498875.901650:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691008 00000100:00100000:0.0:1789498875.901662:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691008 00000100:00100000:0.0:1789498875.901730:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789498875.901740:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885691008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498875.901782:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498875.901831:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885691008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498875.901852:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789498875.901878:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498875.901951:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98e98772b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885691008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498875.902078:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885691136:0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.902188:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498875.902215:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885691648:0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.902243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498875.902704:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498875.902712:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885691264:0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.902740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498875.902777:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691136 00000100:00100000:0.0:1789498875.902784:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691136 00000100:00100000:0.0:1789498875.902831:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789498875.904699:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885691136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.904793:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885691136:12345-0@lo:400:kworker.0 Request processed in 111us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498875.904801:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789498875.905005:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885691392:0@lo:400:kworker.0 00000100:00100000:1.0:1789498875.905044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498875.905073:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498875.905078:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885691520:0@lo:400:kworker.0 00000100:00100000:1.0:1789498875.905112:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498875.905247:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691648 00000100:00100000:0.0:1789498875.905963:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691648 00000100:00100000:0.0:1789498875.906442:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691392 00000100:00100000:0.0:1789498875.906447:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691392 00000100:00100000:0.0:1789498875.906466:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691520 00000100:00100000:0.0:1789498875.906469:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691520 00000100:00100000:0.0:1789498875.906485:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789498875.906492:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885691648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.906548:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885691648:12345-0@lo:400:kworker.0 Request processed in 55us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498875.906554:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789498875.906568:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789498875.906574:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885691392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.906604:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885691392:12345-0@lo:400:kworker.0 Request processed in 31us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498875.906610:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789498875.906621:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789498875.906626:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885691520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.906650:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885691520:12345-0@lo:400:kworker.0 Request processed in 24us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498875.906655:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789498875.906711:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885691136:0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.906743:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885691648:0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.906790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885691520:0@lo:400:kworker.0 00000100:00100000:0.0:1789498875.906800:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885691392:0@lo:400:kworker.0 00000100:00080000:1.0:1789498875.907977:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498875.908976:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691264 00000100:00100000:2.0:1789498875.908986:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691264 00000100:00100000:2.0:1789498875.909061:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789498875.909070:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885691264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498875.909187:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885691264:12345-0@lo:400:kworker.0 Request processed in 118us (6444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498875.909210:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789498875.909426:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498875.909777:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885691264:0@lo:400:kworker.0 00010000:00010000:3.0:1789498876.333308:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498877.358297:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498877.423675:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498877.423710:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885691776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498877.423863:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498877.424139:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691776 00000100:00100000:0.0:1789498877.424153:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691776 00000100:00100000:0.0:1789498877.424243:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789498877.424256:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885691776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498877.424312:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498877.424394:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885691776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498877.424403:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789498877.424486:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885691776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789498877.425851:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789498878.389758:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498879.376134:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498879.376313:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732672 00000100:00100000:3.0:1789498879.376328:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732672 00000100:00100000:3.0:1789498879.376414:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:3.0:1789498879.376427:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864732672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498879.378160:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864732672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1725us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498879.378229:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 210 00000100:00100000:0.0:1789498879.379629:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498879.379702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498879.379921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498879.379960:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732800 00000100:00100000:0.0:1789498879.379973:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732800 00000100:00100000:0.0:1789498879.380045:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733056 00000100:00100000:0.0:1789498879.380049:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733056 00000100:00100000:0.0:1789498879.380077:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 243 00000100:00100000:0.0:1789498879.380109:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864732800:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498879.380431:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864732928 00000100:00100000:3.0:1789498879.380436:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864732928 00000100:00100000:3.0:1789498879.380514:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:3.0:1789498879.380523:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864732928:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498879.380603:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2358:x1876424864732800:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 516us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498879.380611:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 243 00000100:00100000:0.0:1789498879.380643:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 244 00000100:00100000:0.0:1789498879.380651:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864733056:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1789498879.382262:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498879.382273:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498879.382460:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2358:x1876424864732928:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1930us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498879.382475:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1789498879.382603:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2358:x1876424864733056:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1951us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498879.382614:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 244 00010000:00010000:3.0:1789498879.407539:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498880.435727:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498880.491644:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498880.491660:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498880.492215:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498880.492227:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789498881.003416:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885691904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498881.003639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498881.003678:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885691904 00000100:00100000:1.0:1789498881.003702:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885691904 00000100:00100000:2.0:1789498881.003727:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885692416:0@lo:400:kworker.0 00000100:00100000:1.0:1789498881.003776:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789498881.003788:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885691904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498881.003847:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498881.003932:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885692160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498881.004072:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885691904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 287us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498881.004081:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1789498881.004139:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498881.004612:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498881.004640:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885692672:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.004669:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498881.004775:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498881.004788:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885692288:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.004813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498881.005069:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692160 00000100:00100000:0.0:1789498881.005077:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692160 00000100:00100000:0.0:1789498881.005152:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692288 00000100:00100000:0.0:1789498881.005157:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692288 00000100:00100000:0.0:1789498881.005180:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789498881.005188:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885692160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.005245:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885692160:12345-0@lo:400:kworker.0 Request processed in 58us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498881.005252:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789498881.005279:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789498881.005286:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885692288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.005315:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885692288:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498881.005339:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789498881.005373:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885692032:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.005478:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498881.005580:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885692544:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.005607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498881.005643:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692672 00000100:00100000:0.0:1789498881.005647:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692672 00000100:00100000:0.0:1789498881.005681:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692544 00000100:00100000:0.0:1789498881.005684:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692544 00000100:00100000:1.0:1789498881.005816:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789498881.005827:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885692672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498881.005880:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885692672:12345-0@lo:400:kworker.0 Request processed in 55us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498881.005888:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789498881.006020:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789498881.006027:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885692544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.006067:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876424885692544:12345-0@lo:400:kworker.0 Request processed in 40us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498881.006073:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1789498881.006119:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498881.006125:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498881.006158:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876424885692544:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.006191:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885692288:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.006203:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885692160:0@lo:400:kworker.0 00000100:00100000:0.0:1789498881.006213:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885692672:0@lo:400:kworker.0 00000100:00100000:3.0:1789498881.007782:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692032 00000100:00100000:3.0:1789498881.007800:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692032 00000100:00100000:3.0:1789498881.007901:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789498881.007930:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885692032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498881.008037:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885692032:12345-0@lo:400:kworker.0 Request processed in 109us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498881.008045:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789498881.013346:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885692032:0@lo:400:kworker.0 00000100:00100000:2.0:1789498881.014896:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498881.015006:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885691904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498881.016619:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692416 00000100:00100000:1.0:1789498881.016636:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692416 00000100:00100000:1.0:1789498881.016799:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789498881.016814:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885692416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498881.016974:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885692416:12345-0@lo:400:kworker.0 Request processed in 163us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498881.016983:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789498881.017134:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885692416:0@lo:400:kworker.0 00010000:00010000:1.0:1789498881.455428:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789498881.468965:0:22322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 15:01:19 (1789498879) 00010000:00010000:0.0:1789498882.481926:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498882.540841:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498882.540878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885692800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498882.541190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498882.541314:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692800 00000100:00100000:3.0:1789498882.541330:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692800 00000100:00100000:3.0:1789498882.541413:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789498882.541428:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885692800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498882.541498:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498882.541562:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885692800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498882.541570:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789498882.541658:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885692800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498883.499716:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498884.498989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498884.499037:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498884.499078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498884.499138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498884.499202:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733184 00000100:00100000:0.0:1789498884.499215:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733184 00000100:00100000:0.0:1789498884.499283:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 212 00000100:00100000:0.0:1789498884.499296:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864733184:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498884.499401:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e984c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e869000-0a12-4277-a881-2610e585c112+13:2356:x1876424864733184:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498884.499410:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 212 00000100:00100000:0.0:1789498884.499450:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733440 00000100:00100000:0.0:1789498884.499453:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733440 00000100:00100000:0.0:1789498884.499498:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:0.0:1789498884.499506:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864733440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498884.499539:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2356:x1876424864733440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498884.499546:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00080000:0.0:1789498884.499724:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498884.499801:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733312 00000100:00100000:2.0:1789498884.499807:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733312 00000100:00100000:2.0:1789498884.499857:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733568 00000100:00100000:2.0:1789498884.499862:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733568 00000100:00100000:2.0:1789498884.499888:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 248 00000100:00100000:2.0:1789498884.499896:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864733312:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498884.499940:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:2356:x1876424864733312:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498884.499947:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 248 00000100:00100000:2.0:1789498884.499962:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 249 00000100:00100000:2.0:1789498884.499969:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864733568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498884.499995:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2356:x1876424864733568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498884.500002:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 249 00000100:00080000:0.0:1789498884.505119:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498884.529502:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498885.547456:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498886.124246:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885693312:0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.124369:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498886.124457:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885692928:0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.124459:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498886.124465:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885693184:0@lo:400:kworker.0 00000100:00100000:1.0:1789498886.124538:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885693056:0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.124991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498886.125041:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693184 00000100:00100000:0.0:1789498886.125053:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693184 00000100:00100000:0.0:1789498886.125149:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789498886.125160:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885693184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.125267:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885693184:12345-0@lo:400:kworker.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498886.125275:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1789498886.125300:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498886.125335:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885693184:0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.126158:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693312 00000100:00100000:0.0:1789498886.126177:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693312 00000100:00100000:0.0:1789498886.126226:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789498886.126235:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac21d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885693312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.126301:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac21d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885693312:12345-0@lo:400:kworker.0 Request processed in 67us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498886.126308:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789498886.126339:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885693696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498886.126897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498886.127065:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693696 00000100:00100000:0.0:1789498886.127071:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693696 00000100:00100000:0.0:1789498886.127150:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789498886.127160:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885693696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498886.127225:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498886.127277:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e98772b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885693696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498886.127285:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789498886.128554:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885693312:0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.130057:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885693696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498886.134207:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498886.134509:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885693440:0@lo:400:kworker.0 00000100:00100000:2.0:1789498886.134650:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498886.134834:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693440 00000100:00100000:3.0:1789498886.134851:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693440 00000100:00100000:3.0:1789498886.134961:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789498886.134974:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885693440:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789498886.135023:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498886.135063:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885693440:12345-0@lo:400:kworker.0 Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498886.135070:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789498886.135201:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885693440:0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.137085:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885692928 00000100:00100000:0.0:1789498886.137152:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885692928 00000100:00100000:0.0:1789498886.137248:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789498886.137276:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885692928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.137396:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3307:x1876424885692928:12345-0@lo:400:kworker.0 Request processed in 122us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498886.137404:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789498886.138494:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885692928:0@lo:400:kworker.0 00000100:00100000:1.0:1789498886.139186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498886.139244:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885693568:0@lo:400:kworker.0 00000100:00100000:1.0:1789498886.139278:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498886.139538:0:16608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693056 00000100:00100000:0.0:1789498886.139549:0:16608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693056 00000100:00100000:0.0:1789498886.139657:0:16608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789498886.139669:0:16608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885693056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498886.139743:0:16608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885693056:12345-0@lo:400:kworker.0 Request processed in 77us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498886.139750:0:16608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789498886.139847:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693568 00000100:00100000:2.0:1789498886.139852:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693568 00000100:00100000:2.0:1789498886.139906:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789498886.139914:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885693568:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789498886.139929:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498886.139936:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498886.139957:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876424885693568:12345-0@lo:400:kworker.0 Request processed in 45us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498886.139964:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789498886.140081:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885693056:0@lo:400:kworker.0 00000100:00100000:1.0:1789498886.140123:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac21d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876424885693568:0@lo:400:kworker.0 00010000:00010000:3.0:1789498886.573133:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498887.057395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498887.057521:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733824 00000100:00100000:1.0:1789498887.057535:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733824 00000100:00100000:1.0:1789498887.057649:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1789498887.057662:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea8700b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+14:16274:x1876424864733824:12345-192.168.201.20@tcp:35:umount.0 00000100:00100000:1.0:1789498887.058321:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea8700b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:16274:x1876424864733824:12345-192.168.201.20@tcp:35:umount.0 Request processed in 658us (938us total) trans 8589934673 rc 0/0 00000100:00100000:1.0:1789498887.058332:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00080000:3.0:1789498887.059347:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498887.062720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498887.063168:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864733952 00000100:00100000:0.0:1789498887.063182:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864733952 00000100:00100000:0.0:1789498887.063295:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:0.0:1789498887.063308:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e869000-0a12-4277-a881-2610e585c112+13:2358:x1876424864733952:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498887.063335:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498887.063364:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554e00/0x3a6cb1946bc19561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3bf expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498887.063389:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498887.063476:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e869000-0a12-4277-a881-2610e585c112+12:2358:x1876424864733952:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 171us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498887.063484:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498887.075942:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498887.076002:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498887.076164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498887.076563:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864734464 00000100:00100000:3.0:1789498887.076580:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864734464 00000100:00100000:3.0:1789498887.076676:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1789498887.076689:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+6:2354:x1876424864734464:12345-192.168.201.20@tcp:9:umount.0 00000020:00000080:3.0:1789498887.076749:0:15006:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19584 00000020:00010000:3.0:1789498887.076763:0:15006:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98e987721800: total 0 00000100:00080000:3.0:1789498887.076770:0:15006:0:(import.c:65:import_set_state_nolock()) ffff98e987727800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498887.076823:0:15006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:0.0:1789498887.077451:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864734080 00000100:00100000:0.0:1789498887.077461:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864734080 00000100:00100000:0.0:1789498887.077510:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864734208 00000100:00100000:0.0:1789498887.077534:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864734208 00000100:00100000:0.0:1789498887.077568:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1789498887.077580:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+13:2355:x1876424864734080:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498887.077596:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498887.077623:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3e9 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498887.077645:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498887.077735:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+12:2355:x1876424864734080:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 155us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498887.077743:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1789498887.077765:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498887.077772:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+11:2355:x1876424864734208:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498887.077780:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498887.077791:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa5400/0x3a6cb1946bc195df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a48a expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498887.077801:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498887.077820:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+10:2355:x1876424864734208:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 48us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498887.077827:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000020:00010000:1.0:1789498887.078069:0:14312:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98e987721800: total 0 00010000:00010000:1.0:1789498887.078161:0:14312:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e987721800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1789498887.078204:0:14312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789498887.078208:0:14312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789498887.078229:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028baf00c/0x3a6cb1946bc19b65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5fd expref: 5 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.078272:0:14312:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e987721800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789498887.078285:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498887.078287:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498887.078289:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498887.078367:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498887.079407:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68cd9685-a43a-48ba-9cd1-2238ca644a97+2:2354:x1876424864734464:12345-192.168.201.20@tcp:9:umount.0 Request processed in 2711us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498887.079421:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1789498887.099294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498887.099486:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864735360 00000100:00100000:3.0:1789498887.099501:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864735360 00000100:00100000:3.0:1789498887.099588:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:3.0:1789498887.099602:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+15:2354:x1876424864735360:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:3.0:1789498887.099664:0:14324:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19576 00000020:00010000:3.0:1789498887.099687:0:14324:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98ea84cec800: total 0 00000100:00080000:3.0:1789498887.099693:0:14324:0:(import.c:65:import_set_state_nolock()) ffff98e9877b1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498887.099753:0:14324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934673 00000020:00010000:1.0:1789498887.100035:0:14311:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98ea84cec800: total 0 00010000:00010000:1.0:1789498887.100041:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498887.100159:0:14311:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98ea84cec800, canceled 0 locks, left on hash table 9. 00010000:00010000:1.0:1789498887.100204:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98ea84ebf400) 00010000:00010000:1.0:1789498887.100208:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498887.100221:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5a00/0x3a6cb1946bc19625 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a491 expref: 14 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100433:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498887.100443:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789498887.100459:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5e00/0x3a6cb1946bc196fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4d0 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100494:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498887.100497:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498887.100502:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc19b11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5e1 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100524:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498887.100526:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789498887.100530:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00c00/0x3a6cb1946bc199a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a58d expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100578:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:1.0:1789498887.100581:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498887.100585:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90e00/0x3a6cb1946bc19ab6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a5cc expref: 10 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100607:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff98ea82c62500) 00010000:00010000:1.0:1789498887.100610:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789498887.100627:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4800/0x3a6cb1946bc19bc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a619 expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100648:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea82c62800) 00010000:00010000:1.0:1789498887.100653:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498887.100658:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555000/0x3a6cb1946bc19641 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a498 expref: 8 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100682:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:1.0:1789498887.100684:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498887.100687:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eab6555e00/0x3a6cb1946bc19679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4a6 expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100700:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98ea82c62000) 00010000:00010000:1.0:1789498887.100702:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498887.100705:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc19b7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a604 expref: 6 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498887.100737:0:14311:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98ea84cec800, canceled 9 locks, left on hash table 0. 00010000:00010000:1.0:1789498887.100773:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498887.100781:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498887.100784:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498887.104517:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68cd9685-a43a-48ba-9cd1-2238ca644a97+4:2354:x1876424864735360:12345-192.168.201.20@tcp:39:umount.0 Request processed in 4898us (5219us total) trans 8589934674 rc 0/0 00000100:00100000:3.0:1789498887.104539:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 108 00010000:00010000:3.0:1789498887.595884:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498887.659395:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498887.659437:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885693824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498887.659563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498887.659885:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693824 00000100:00100000:3.0:1789498887.659921:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693824 00000100:00100000:3.0:1789498887.660010:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789498887.660022:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885693824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498887.660086:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498887.660196:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885693824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498887.660205:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789498887.660675:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885693824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498888.626068:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498889.123540:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498889.123598:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498889.123780:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498889.137905:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864735488 00000100:00100000:2.0:1789498889.137927:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864735488 00000100:00100000:2.0:1789498889.138034:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498889.138080:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736000 00000100:00100000:2.0:1789498889.138084:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736000 00000100:00100000:2.0:1789498889.138218:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:2.0:1789498889.138231:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+6:2354:x1876424864736000:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:2.0:1789498889.138287:0:14325:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc195ae 00000020:00010000:2.0:1789498889.138299:0:14325:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98ea891f2800: total 0 00000100:00080000:2.0:1789498889.138305:0:14325:0:(import.c:65:import_set_state_nolock()) ffff98ea891f2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789498889.138342:0:14325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934674 00000100:00100000:2.0:1789498889.138643:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a+5:2354:x1876424864736000:12345-192.168.201.20@tcp:39:umount.0 Request processed in 414us (612us total) trans 8589934675 rc 0/0 00000100:00100000:2.0:1789498889.138652:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00080000:2.0:1789498889.138678:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1789498889.139305:0:14311:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98ea891f2800: total 0 00010000:00010000:0.0:1789498889.139374:0:14311:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98ea891f2800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789498889.139417:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c400) 00010000:00010000:0.0:1789498889.139435:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498889.139449:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc19687 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a4ad expref: 4 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498889.139479:0:14311:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98ea891f2800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789498889.139493:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498889.139495:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498889.139497:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498889.142204:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864735744 00000100:00100000:0.0:1789498889.142284:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864735616 00000100:00100000:0.0:1789498889.142298:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864735616 00000100:00100000:0.0:1789498889.142384:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498889.142398:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e869000-0a12-4277-a881-2610e585c112+11:2357:x1876424864735488:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498889.142420:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498889.142446:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad90400/0x3a6cb1946bc19599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a421 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498889.142469:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498889.142559:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e869000-0a12-4277-a881-2610e585c112+10:2357:x1876424864735488:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 164us (19034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498889.142567:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498889.142589:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498889.142595:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e869000-0a12-4277-a881-2610e585c112+9:2357:x1876424864735616:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498889.142612:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498889.142623:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad91000/0x3a6cb1946bc195a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a44b expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498889.142632:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498889.142649:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e869000-0a12-4277-a881-2610e585c112+8:2357:x1876424864735616:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 54us (18870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498889.144312:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498889.145186:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864735744 00000100:00100000:2.0:1789498889.145305:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498889.145316:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+8:2357:x1876424864735744:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498889.145335:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498889.147499:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad90200/0x3a6cb1946bc195d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a483 expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498889.147534:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498889.149197:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e869000-0a12-4277-a881-2610e585c112+7:2357:x1876424864735744:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 3864us (25578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498889.149219:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:0.0:1789498889.166025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498889.166133:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736256 00000100:00100000:3.0:1789498889.166224:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736256 00000100:00100000:3.0:1789498889.166303:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:3.0:1789498889.166316:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+7:2354:x1876424864736256:12345-192.168.201.20@tcp:251:umount.0 00000020:00000080:3.0:1789498889.166380:0:14316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19553 00000020:00010000:3.0:1789498889.166390:0:14316:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98ea891f7800: total 0 00000100:00080000:3.0:1789498889.166954:0:14316:0:(import.c:65:import_set_state_nolock()) ffff98ea891f1000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789498889.167174:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e869000-0a12-4277-a881-2610e585c112+3:2354:x1876424864736256:12345-192.168.201.20@tcp:251:umount.0 Request processed in 857us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498889.167185:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 214 00000020:00010000:1.0:1789498889.182057:0:15943:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98ea891f7800: total 0 00010000:00010000:3.0:1789498889.186733:0:15943:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98ea891f7800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789498889.186824:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6555a00/0x3a6cb1946bc1955a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a3b8 expref: 2 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498889.186847:0:15943:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98ea891f7800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789498889.186858:0:15943:0:(genops.c:885:class_export_put()) final put ffff98ea891f7800/7e869000-0a12-4277-a881-2610e585c112 00010000:00010000:3.0:1789498889.186890:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498889.186893:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498889.186896:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789498889.187003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891f7800/7e869000-0a12-4277-a881-2610e585c112 for MGS 00000020:00000080:2.0:1789498889.187078:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea891f1000 for MGS 00010000:00010000:1.0:1789498889.645982:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789498889.813616:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934673 is committed 00000001:00100000:2.0:1789498889.813638:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000001:00080000:2.0:1789498889.813647:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00000080:2.0:1789498889.813661:0:5867:0:(genops.c:885:class_export_put()) final put ffff98ea891f2800/b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a 00000001:00100000:2.0:1789498889.814163:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68cd9685-a43a-48ba-9cd1-2238ca644a97 00000001:00080000:2.0:1789498889.814173:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00000080:2.0:1789498889.814177:0:5867:0:(genops.c:885:class_export_put()) final put ffff98ea84cec800/68cd9685-a43a-48ba-9cd1-2238ca644a97 00000020:00000080:3.0:1789498889.814275:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891f2800/b5eed0e0-9e5c-46d3-be0d-45c6d6ee921a for lustre-MDT0000 00000020:00000080:3.0:1789498889.814363:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea84cec800/68cd9685-a43a-48ba-9cd1-2238ca644a97 for lustre-MDT0000 00000020:00000080:3.0:1789498889.814412:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea891f2000 for lustre-MDT0000 00000020:00000080:3.0:1789498889.814417:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e9877b1000 for lustre-MDT0000 00010000:00010000:0.0:1789498890.667918:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498890.733640:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789498890.733656:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498890.734515:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1789498890.734601:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:01000004:1.0:1789498891.193508:0:22518:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789498891.210782:0:22518:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789498891.210930:0:22518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498891.210950:0:22518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498891.210958:0:22518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498891.210966:0:22518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498891.211001:0:22518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789498891.211008:0:22518:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789498891.211035:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498891.211041:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789498891.211050:0:22518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498891.211117:0:22518:0:(import.c:65:import_set_state_nolock()) ffff98ea85c62000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789498891.211968:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885693952:0@lo:39:umount.0 00000100:00100000:3.0:1789498891.212083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498891.212278:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498891.212289:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.212301:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498891.212307:0:15943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.212319:0:15943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498891.212327:0:15943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498891.212334:0:15943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498891.212338:0:15943:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789498891.212341:0:15943:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789498891.212384:0:15943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.212391:0:15943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498891.212419:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.212427:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad90000/0x3a6cb1946bc19282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19289 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.212470:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498891.212472:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498891.212475:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498891.212498:0:16313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885693952 00000100:00100000:0.0:1789498891.212507:0:16313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885693952 00000100:00100000:1.0:1789498891.212681:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498891.212697:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885694080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498891.212744:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498891.213404:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789498891.213420:0:16313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876424885693952:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789498891.213460:0:16313:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc192b3 00000100:00080000:0.0:1789498891.213474:0:16313:0:(import.c:65:import_set_state_nolock()) ffff98e98441e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789498891.213912:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498891.214279:0:16313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1876424885693952:12345-0@lo:39:umount.0 Request processed in 860us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498891.214291:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000020:00000080:0.0:1789498891.214307:0:16313:0:(genops.c:885:class_export_put()) final put ffff98e98454f000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1789498891.214354:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694080 00000100:00100000:0.0:1789498891.214363:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694080 00000100:00100000:0.0:1789498891.214415:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498891.214423:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea87233850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3308:x1876424885694080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498891.214436:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498891.214459:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad91400/0x3a6cb1946bc19289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc19282 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.214478:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498891.214525:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea87233850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:3308:x1876424885694080:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498891.214532:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498891.216354:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885694080:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789498891.216622:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea85c62000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789498891.216649:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885693952:0@lo:39:umount.0 00000020:00000080:1.0:1789498891.216705:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98454f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789498891.216793:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e98441e800 for lustre-MDT0000 00000100:00080000:0.0:1789498891.217951:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789498891.217959:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789498891.217968:0:22518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789498891.221486:0:22518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.221515:0:22518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.221523:0:22518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.221530:0:22518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.221555:0:22518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498891.221715:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498891.221725:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.221733:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91a00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498891.221739:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.221750:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498891.221759:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498891.221765:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498891.221767:0:14311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789498891.221893:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.221901:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789498891.221976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789498891.221999:0:22518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222008:0:22518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222014:0:22518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222020:0:22518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222041:0:22518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498891.222067:0:22518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222083:0:22518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222112:0:22518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222119:0:22518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222145:0:22518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498891.222159:0:22518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222166:0:22518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222173:0:22518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222181:0:22518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498891.222190:0:22518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789498891.222194:0:22518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789498891.222199:0:22518:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789498891.222239:0:22518:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789498891.222244:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789498891.222249:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.222261:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789498891.222271:0:22518:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98ea891f4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498891.222277:0:22518:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98ea90a2f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498891.222282:0:22518:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff98eabadc4d40) has exports, disconnecting them 00000020:00080000:2.0:1789498891.222287:0:22518:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98ea891f4000), last request at 1789498886 00000020:00000080:2.0:1789498891.222294:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19473 00000100:00080000:2.0:1789498891.222314:0:22518:0:(import.c:65:import_set_state_nolock()) ffff98ea891f7000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789498891.222373:0:22518:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98ea891f4000): rc 0 00000020:00000080:2.0:1789498891.222376:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea891f4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789498891.222387:0:22518:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98ea90a2f000), last request at 1789498886 00000020:00000080:2.0:1789498891.222390:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19338 00000100:00080000:2.0:1789498891.222395:0:22518:0:(import.c:65:import_set_state_nolock()) ffff98ea90a2c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789498891.222402:0:22518:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98ea90a2f000): rc 0 00000020:00000080:2.0:1789498891.222404:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea90a2f000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789498891.222413:0:22518:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba75c3e97ae0 00000100:00080000:2.0:1789498891.222439:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789498891.222445:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 3 00000004:00080000:2.0:1789498891.222461:0:22518:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789498891.222530:0:22518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789498891.222545:0:22518:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789498891.222558:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789498891.222572:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:2.0:1789498891.222584:0:22518:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789498891.222664:0:22518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789498891.222674:0:22518:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789498891.222706:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98eabadc4d40) has no exports 00010000:00010000:0.0:1789498891.222777:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222786:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad91a00/0x3a6cb1946bc191e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc191ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222802:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789498891.222826:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222834:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498891.222837:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222844:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498891.222851:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498891.222856:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498891.222859:0:14311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789498891.222862:0:14311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789498891.222882:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222888:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498891.222913:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222919:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4e00/0x3a6cb1946bc19481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19488 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222933:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498891.222937:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222942:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5c00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498891.222951:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222959:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498891.222965:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498891.222970:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789498891.222972:0:14311:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789498891.222974:0:14311:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789498891.222989:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.222995:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498891.223001:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.223007:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19602 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19609 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.223016:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498891.223019:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.223024:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498891.223026:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.223033:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498891.223045:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498891.223050:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498891.223052:0:14311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789498891.223054:0:14311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789498891.223066:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.223083:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789498891.223245:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885694592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498891.223342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498891.223417:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498891.223424:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885694720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498891.223448:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498891.223753:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498891.223766:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885694848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498891.223817:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498891.223869:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694592 00000100:00100000:1.0:1789498891.223879:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694592 00000100:00100000:1.0:1789498891.223938:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694720 00000100:00100000:1.0:1789498891.223942:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694720 00000100:00100000:1.0:1789498891.223958:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694848 00000100:00100000:1.0:1789498891.223961:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694848 00000100:00100000:1.0:1789498891.223994:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498891.224002:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+20:3305:x1876424885694592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498891.224019:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498891.224041:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6555c00/0x3a6cb1946bc19488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc19481 expref: 20 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.224062:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498891.224141:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+19:3305:x1876424885694592:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498891.224161:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498891.224185:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498891.224193:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+18:3305:x1876424885694720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498891.224201:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498891.224211:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19609 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc19602 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.224221:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498891.224251:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+17:3305:x1876424885694720:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498891.224258:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498891.224270:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498891.224276:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+16:3308:x1876424885694848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498891.224284:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498891.224293:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91098400/0x3a6cb1946bc191e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc191da expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.224303:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498891.224334:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:3308:x1876424885694848:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498891.224341:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498891.224382:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885694720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498891.224391:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885694592:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789498891.224424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea891f4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789498891.224487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea90a2f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789498891.224513:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea891f7000 for lustre-MDT0000 00000020:00000080:1.0:1789498891.224519:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea90a2c800 for lustre-MDT0000 00000100:00100000:1.0:1789498891.224542:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885694848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498891.224564:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885694336:0@lo:9:umount.0 00000100:00100000:1.0:1789498891.224597:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498891.224625:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885694464:0@lo:9:umount.0 00000100:00100000:1.0:1789498891.224650:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498891.224683:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694336 00000100:00100000:1.0:1789498891.224687:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694336 00000100:00100000:1.0:1789498891.224730:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694464 00000100:00100000:1.0:1789498891.224733:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694464 00000100:00100000:1.0:1789498891.224758:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498891.224766:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876424885694336:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789498891.224793:0:15008:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19354 00000100:00080000:1.0:1789498891.224804:0:15008:0:(import.c:65:import_set_state_nolock()) ffff98ea88a97800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498891.224839:0:15008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789498891.225317:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3304:x1876424885694336:12345-0@lo:9:umount.0 Request processed in 550us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498891.225325:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498891.225352:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789498891.225360:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876424885694464:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789498891.225376:0:15008:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1948f 00000100:00080000:1.0:1789498891.225384:0:15008:0:(import.c:65:import_set_state_nolock()) ffff98ea894f9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498891.225400:0:15008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1789498891.225504:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3304:x1876424885694464:12345-0@lo:9:umount.0 Request processed in 145us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498891.225511:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789498891.225533:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498891.225538:0:14319:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498891.225574:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eaba5d5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789498891.225584:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789498891.225587:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789498891.225590:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885694336:0@lo:9:umount.0 00000100:00080000:1.0:1789498891.225600:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea82998800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789498891.225604:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789498891.225606:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789498891.225608:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885694464:0@lo:9:umount.0 00010000:00010000:1.0:1789498891.225675:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498891.226414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885694208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498891.226483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789498891.226569:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498891.226714:0:16441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694208 00000100:00100000:3.0:1789498891.226737:0:16441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694208 00000100:00100000:3.0:1789498891.226799:0:16441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498891.226822:0:16441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1cf59db6-3bc5-4ded-8751-c46e361eaced+15:3307:x1876424885694208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498891.226840:0:16441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498891.226867:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099200/0x3a6cb1946bc191ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc191e8 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498891.226885:0:16441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498891.226925:0:16441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:3307:x1876424885694208:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498891.226932:0:16441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498891.226978:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885694208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498891.228296:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498891.228312:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad90600/0x3a6cb1946bc191da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc191e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.228501:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498891.228504:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498891.228507:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789498891.234942:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98eabadc4d40) has no exports 00000100:00100000:3.0:1789498891.247287:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498891.247318:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885694976:0@lo:400:kworker.0 00000100:00100000:3.0:1789498891.247429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498891.247507:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885694976 00000100:00100000:3.0:1789498891.247518:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885694976 00000100:00100000:3.0:1789498891.247594:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789498891.247606:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:3307:x1876424885694976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498891.247671:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea85c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf59db6-3bc5-4ded-8751-c46e361eaced+14:3307:x1876424885694976:12345-0@lo:400:kworker.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498891.247679:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789498891.247726:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885695104:0@lo:400:kworker.0 00000100:00100000:3.0:1789498891.247760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498891.247786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498891.247792:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885695232:0@lo:400:kworker.0 00000100:00100000:3.0:1789498891.248151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498891.248208:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695104 00000100:00100000:3.0:1789498891.248213:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695104 00000100:00100000:3.0:1789498891.248237:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695232 00000100:00100000:3.0:1789498891.248239:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695232 00000100:00100000:3.0:1789498891.248254:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789498891.248260:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876424885695104:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789498891.248267:0:14325:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789498891.248307:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876424885695104:12345-0@lo:400:kworker.0 Request processed in 45us (545us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789498891.248313:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789498891.248325:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789498891.248328:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876424885695232:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789498891.248332:0:14325:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789498891.248352:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876424885695232:12345-0@lo:400:kworker.0 Request processed in 23us (212us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789498891.248358:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789498891.248400:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1cf59db6-3bc5-4ded-8751-c46e361eaced:3307:1876424885694976:0@lo:400:kworker.0 00000100:00080000:3.0:1789498891.248430:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789498891.248437:0:3305:0:(import.c:65:import_set_state_nolock()) ffff98e9877b5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789498891.248442:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789498891.269681:0:3305:0:(import.c:65:import_set_state_nolock()) ffff98e9877b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498891.269702:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1789498891.269726:0:3305:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e9877b5000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498891.269787:0:3305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9fa1500 x1876424885695360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498891.269831:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885695232:0@lo:400:kworker.0 00000100:00080000:3.0:1789498891.269904:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789498891.269908:0:3305:0:(import.c:65:import_set_state_nolock()) ffff98e987722800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789498891.269912:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789498891.269930:0:3305:0:(import.c:65:import_set_state_nolock()) ffff98e987722800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498891.269935:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 511 00000100:00080000:3.0:1789498891.269941:0:3305:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e987722800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498891.269958:0:3305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9fa2d80 x1876424885695488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498891.269969:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885695104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498891.272163:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885695360:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789498891.272272:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498891.272312:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885695488:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789498891.272338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498891.272389:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695360 00000100:00100000:1.0:1789498891.272399:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695360 00000100:00100000:1.0:1789498891.272461:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695488 00000100:00100000:1.0:1789498891.272464:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695488 00000100:00100000:1.0:1789498891.272486:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789498891.272494:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885695360:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789498891.272518:0:14323:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789498891.273422:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789498891.273434:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885695488:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789498891.273452:0:14325:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789498891.273537:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885695488:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 101us (1196us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498891.273545:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789498891.273607:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e987722800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498891.273613:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498891.273617:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885695488:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789498891.284766:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885695360:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 12256us (12479us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789498891.284785:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789498891.285434:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e9877b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498891.285443:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498891.285449:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885695360:0@lo:38:ptlrpcd_00_00.0 00000020:00000080:2.0:1789498891.322372:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19235 00000020:00000080:2.0:1789498891.322401:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea85705800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789498891.322483:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789498891.322587:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea85705800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789498891.322638:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498891.322677:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789498891.322683:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff98e9852699c0) has no exports 00000020:00000080:3.0:1789498891.323383:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1922e 00000020:00000080:3.0:1789498891.323394:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea85706000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789498891.323481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea85706000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789498891.323563:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498891.323575:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789498891.323579:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea85707000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789498891.323581:0:22518:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea85707000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789498891.323587:0:22518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1789498891.323750:0:22518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea86779f60 - data ffff98eab13df000/ffff98e983e08800 00000020:01000000:3.0:1789498891.324387:0:22518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea88691f00 - data ffff98eab83ab6c0/ffff98eaa93b2800 00000001:00000004:1.0:1789498891.338539:0:22518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934675 00000001:00100000:3.0:1789498891.339960:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789498891.339973:0:7653:0:(genops.c:885:class_export_put()) final put ffff98ea894ff000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498891.341050:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea894ff000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789498891.341284:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea894f9000 for lustre-OST0001 00000001:00100000:3.0:1789498891.343369:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68cd9685-a43a-48ba-9cd1-2238ca644a97 00000020:00000080:3.0:1789498891.343380:0:7653:0:(genops.c:885:class_export_put()) final put ffff98e987721800/68cd9685-a43a-48ba-9cd1-2238ca644a97 00000020:00000080:3.0:1789498891.343435:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987721800/68cd9685-a43a-48ba-9cd1-2238ca644a97 for lustre-OST0001 00000020:00000080:3.0:1789498891.343494:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987727800 for lustre-OST0001 00000100:00080000:2.0:1789498891.405195:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789498891.405207:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 4 00000004:00080000:2.0:1789498891.405234:0:22518:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498891.405238:0:22518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789498891.406745:0:14344:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789498891.406754:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 3 count 1 00000040:00080000:3.0:1789498891.406768:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789498891.408362:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789498891.408372:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1789498891.408389:0:22518:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498891.408392:0:22518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789498891.409797:0:14347:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789498891.409805:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1789498891.409822:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789498891.514159:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc191fd 00000020:00000080:2.0:1789498891.514178:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eac0a94800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789498891.515854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0a94800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789498891.519060:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19212 00000020:00000080:2.0:1789498891.519110:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba5d7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789498891.519125:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789498891.519132:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.519144:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789498891.519149:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff98eabadc0000) has no exports 00000004:01000000:2.0:1789498891.519395:0:22518:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789498891.519407:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1925f 00000020:00000080:2.0:1789498891.519411:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba5d1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789498891.519416:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789498891.519420:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.519441:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789498891.519444:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff98eabb5599c0) has no exports 00000020:00000080:2.0:1789498891.519452:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19258 00000020:00000080:2.0:1789498891.519456:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea8299c800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789498891.519879:0:22518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789498891.519887:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789498891.519893:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:2.0:1789498891.519902:0:22518:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498891.519906:0:22518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498891.519944:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.519952:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789498891.519959:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1924a 00000020:00000080:2.0:1789498891.519965:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba5d0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789498891.519968:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789498891.519972:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.519975:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789498891.519978:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff98eabadc19c0) has no exports 00000020:00000080:2.0:1789498891.519982:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19243 00000020:00000080:2.0:1789498891.519985:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba5d2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789498891.522400:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789498891.522443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789498891.522451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea8299c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789498891.522462:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea82998800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789498891.522475:0:36:0:(genops.c:885:class_export_put()) final put ffff98eaba5d4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789498891.522500:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789498891.522507:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498891.522635:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789498891.522643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789498891.523805:0:22518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789498891.523813:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789498891.523818:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 5 00000004:00080000:2.0:1789498891.523828:0:22518:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498891.523831:0:22518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498891.523928:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.523941:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789498891.523982:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.523986:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789498891.523992:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eac0a92000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498891.523996:0:22518:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0a92000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789498891.524001:0:22518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789498891.524216:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19219 00000020:00000080:2.0:1789498891.524234:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba5d5800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789498891.524240:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789498891.524244:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.524249:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789498891.524254:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff98eabadc3380) has no exports 00000020:00000080:2.0:1789498891.524283:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.524286:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789498891.524292:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19220 00000020:00000080:2.0:1789498891.524296:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba5d3800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789498891.524306:0:22518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eaba3b0800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789498891.524310:0:22518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eaba3b0800 3 00000020:01000004:2.0:1789498891.524314:0:22518:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98eaba3b0800 from lustre-MDT0000 00000020:00000080:2.0:1789498891.524335:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.524338:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789498891.524341:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eac0a96800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789498891.524343:0:22518:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0a96800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789498891.524351:0:22518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789498891.524379:0:22518:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789498891.524382:0:22518:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789498891.524385:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789498891.524388:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.524390:0:22518:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789498891.524399:0:22518:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff98ea8884f000 1cf59db6-3bc5-4ded-8751-c46e361eaced 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498891.524405:0:22518:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff98e98526cd40) has exports, disconnecting them 00000020:00080000:2.0:1789498891.524410:0:22518:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98ea8884f000), last request at 1789498595 00000020:00000080:2.0:1789498891.524429:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc191c5 00000020:00010000:2.0:1789498891.524433:0:22518:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98ea8884f000: total 2 00000100:00080000:2.0:1789498891.524438:0:22518:0:(import.c:65:import_set_state_nolock()) ffff98ea88848800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789498891.524577:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98eaba5d5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789498891.524585:0:36:0:(genops.c:885:class_export_put()) final put ffff98eaba5d4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789498891.524587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789498891.524593:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498891.524679:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789498891.524683:0:36:0:(genops.c:885:class_export_put()) final put ffff98eac0a91000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789498891.524685:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0a91000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789498891.524689:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789498891.524801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba5d3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1789498891.525657:0:22518:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98ea8884f000): rc 0 00000020:00080000:2.0:1789498891.525670:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff98e98526cd40) has no exports 00000100:00100000:3.0:1789498891.525949:0:14318:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff98eabad83200:14318] 2 exiting: rc = 0 00000100:00100000:3.0:1789498891.526064:0:14315:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff98ea83f52200:14315] 0 exiting: rc = 1 00000100:00100000:3.0:1789498891.526143:0:14316:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff98ea83f53000:14316] 1 exiting: rc = 0 00000100:00100000:2.0:1789498891.526423:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.526434:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.526458:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.526465:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1789498891.526745:0:15943:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98ea8884f000: total 0 00010000:00010000:1.0:1789498891.526751:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498891.526801:0:15943:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98ea8884f000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789498891.526841:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc191d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc191cc expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526864:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc195ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc195e6 expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526876:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099e00/0x3a6cb1946bc19323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc1931c expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526888:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e01e00/0x3a6cb1946bc195fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc195f4 expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526904:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf400/0x3a6cb1946bc1945e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc19457 expref: 5 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526915:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099800/0x3a6cb1946bc192f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc192f2 expref: 4 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526926:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea91099000/0x3a6cb1946bc192eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc192e4 expref: 3 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526946:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eab6554400/0x3a6cb1946bc19434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3a6cb1946bc1942d expref: 2 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498891.526958:0:15943:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98ea8884f000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789498891.526972:0:15943:0:(genops.c:885:class_export_put()) final put ffff98ea8884f000/1cf59db6-3bc5-4ded-8751-c46e361eaced 00010000:00010000:1.0:1789498891.526993:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498891.526995:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498891.526997:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498891.527927:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527939:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527946:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527952:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527959:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527970:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527978:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527985:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527990:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.527997:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528005:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528012:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528018:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528024:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528032:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528039:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528044:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528050:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528056:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528061:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528077:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528083:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528103:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528110:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528117:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528123:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528130:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528137:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528145:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528151:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528158:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528165:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528171:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528192:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528200:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528207:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528212:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528219:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528226:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528233:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528240:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528246:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528252:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528261:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528267:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528273:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528284:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528293:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528300:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528306:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528314:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528321:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528328:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528334:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528342:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528347:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528353:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528360:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528367:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.528374:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789498891.528988:0:22518:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789498891.528993:0:22518:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1789498891.530974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea8884f000/1cf59db6-3bc5-4ded-8751-c46e361eaced for MGS 00000020:00000080:3.0:1789498891.531050:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea88848800 for MGS 00000020:01000000:3.0:1789498891.533630:0:22518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea84d45e40 - data ffff98ea9cbfc948/ffff98e98539b400 00000020:01000000:3.0:1789498891.533793:0:22518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e983e5c900 - data ffff98eab83ab5e8/ffff98ea8a259800 00000020:00000080:3.0:1789498891.534426:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc191a9 00000020:00000080:3.0:1789498891.534437:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba3b1000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789498891.534457:0:22518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eaba3b0800 from MGS, refs=2 00000020:01000004:3.0:1789498891.534462:0:22518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eaba3b0800 2 00000020:01000004:3.0:1789498891.534465:0:22518:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98eaba3b0800 from MGS 00000020:00000080:3.0:1789498891.534495:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498891.534504:0:22518:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789498891.534507:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba3b6800/MGS 00000020:00000080:3.0:1789498891.534510:0:22518:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba3b6800/MGS for MGS 00000020:01000000:3.0:1789498891.534534:0:22518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789498891.534608:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789498891.534613:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498891.534619:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789498891.534628:0:22518:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98ea83f89000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789498891.534634:0:22518:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff98ea83f28000) has exports, disconnecting them 00000020:00080000:3.0:1789498891.534640:0:22518:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98ea83f89000), last request at 1789498596 00000020:00000080:3.0:1789498891.534646:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19297 00000020:00080000:3.0:1789498891.534657:0:22518:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98ea83f89000): rc 0 00000020:00000080:3.0:1789498891.534663:0:22518:0:(genops.c:885:class_export_put()) final put ffff98ea83f89000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789498891.535494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba3b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789498891.535513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea83f89000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789498891.537515:0:22518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789498891.537528:0:22518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498891.537535:0:22518:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789498891.537731:0:22518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498891.537989:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.538001:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789498891.538011:0:22518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eaba3b0800 1 00000020:00000080:2.0:1789498891.538020:0:22518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1919b 00000020:00000080:2.0:1789498891.538032:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba3b2000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789498891.538039:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789498891.538045:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.538050:0:22518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789498891.538055:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff98e985268000) has no exports 00000020:00000080:0.0:1789498891.538271:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea85c62000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789498891.538280:0:37:0:(genops.c:885:class_export_put()) final put ffff98ea85c66000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789498891.538284:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea85c66000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789498891.538299:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789498891.538382:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba3b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789498891.594293:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498891.594317:0:22518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789498891.594325:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba3b3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789498891.594332:0:22518:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba3b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789498891.594352:0:22518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789498891.594514:0:22518:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98eaba3b0000 00000020:01000000:2.0:1789498891.594543:0:22518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789498891.594548:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498891.594654:0:22518:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789498891.594660:0:22518:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff98e98526b380) has no exports 00000100:00100000:0.0:1789498891.595749:0:14325:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff98e986aec200:14325] 2 exiting: rc = 0 00000100:00100000:1.0:1789498891.596818:0:14323:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff98ea87e8c800:14323] 0 exiting: rc = 1 00000100:00100000:2.0:1789498891.603320:0:14324:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff98ea83f0a600:14324] 1 exiting: rc = 0 00000100:00100000:2.0:1789498891.605244:0:16313:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff98ea846d5200:16313] 3 exiting: rc = 0 00000100:00100000:0.0:1789498891.605435:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605446:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605456:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605462:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605469:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605475:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605481:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605506:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605512:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605519:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605525:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605532:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605539:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605546:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605551:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605569:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605576:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605583:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605589:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605600:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605607:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605612:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605624:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605630:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605636:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605643:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605651:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605659:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605666:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605672:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605679:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605686:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605693:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605699:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605706:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605712:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605720:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605727:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605735:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605759:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605768:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605775:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605789:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605795:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605802:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605810:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605816:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605822:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605828:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605833:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605839:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605845:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605853:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605860:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605867:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605876:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605883:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605889:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605895:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605901:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605907:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605914:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605921:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.605928:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.610185:0:14327:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98ea83f0a000:14327] 1 exiting: rc = 0 00000100:00100000:0.0:1789498891.614373:0:14326:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98e986aed800:14326] 0 exiting: rc = 1 00000100:00100000:2.0:1789498891.617208:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617224:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617234:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617243:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617250:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617260:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617265:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617272:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617279:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617285:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617308:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617314:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617322:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617328:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617336:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617342:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617348:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617354:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617360:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617366:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617373:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617379:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617384:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617391:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617397:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617403:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617409:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617415:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617421:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617427:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617434:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617441:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617447:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617453:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617459:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617465:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617471:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617477:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617483:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617488:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617493:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617500:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617506:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617512:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617518:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617532:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617537:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617543:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617550:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617878:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617888:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617895:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617901:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617907:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617913:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617920:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617927:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617932:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617938:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617944:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617952:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617958:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617963:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.617969:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.618797:0:14329:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff98ea87da1e00:14329] 1 exiting: rc = 0 00000100:00100000:2.0:1789498891.619219:0:14328:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff98ea8574b200:14328] 0 exiting: rc = 1 00000100:00100000:2.0:1789498891.619286:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619294:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619302:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619309:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619316:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619332:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619340:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619347:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619354:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619362:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619369:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619375:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619383:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619391:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619397:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619418:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619426:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619449:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619457:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619464:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619472:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619479:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619485:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619494:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619501:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619508:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619516:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619523:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619530:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619553:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619575:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619582:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619591:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619597:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619604:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619610:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619616:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619622:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619629:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619636:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619644:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619667:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619676:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619683:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619691:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619699:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619706:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619712:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619719:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619726:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619739:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619746:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619753:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619777:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619789:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619797:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619804:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619810:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619817:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619825:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619832:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619839:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619846:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.619854:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644382:0:14330:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98eabb2f9e00:14330] 0 exiting: rc = 1 00000100:00100000:2.0:1789498891.644732:0:14331:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98eabb2f8000:14331] 1 exiting: rc = 0 00000100:00100000:0.0:1789498891.644909:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644919:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644925:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644931:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644942:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644948:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644954:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644960:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644967:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.644973:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645003:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645008:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645013:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645019:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645024:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645030:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645035:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645041:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645047:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645052:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645057:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645062:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645079:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.645085:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648297:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648333:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648340:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648346:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648352:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648358:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648364:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648370:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648375:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648382:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648388:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648394:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648400:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648406:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648412:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648418:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648424:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648430:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648435:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648442:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648448:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648480:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648485:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648492:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648497:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648503:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648508:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648514:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648520:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648526:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648531:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648537:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648543:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648548:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648553:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648558:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648625:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648634:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648639:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.648644:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649224:0:14333:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98eabb2f9400:14333] 1 exiting: rc = 0 00000100:00100000:3.0:1789498891.649741:0:14332:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98eabb2f8600:14332] 0 exiting: rc = 1 00000100:00100000:0.0:1789498891.649943:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649951:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649956:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649962:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649968:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649974:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649979:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649984:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649991:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.649996:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650001:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650006:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650011:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650017:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650021:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650039:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650044:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650050:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650055:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650060:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650075:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650081:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650087:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650313:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650320:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650325:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650331:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650337:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650342:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650347:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650353:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650358:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650364:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650369:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650375:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650381:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650386:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650393:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650399:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650405:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650411:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650416:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650422:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650428:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650433:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650439:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650444:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650449:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650455:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650461:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650475:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650481:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650487:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650492:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650498:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650503:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650509:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650516:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650522:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650528:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650534:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650540:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650546:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.650552:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651225:0:14335:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff98eaa5ee3e00:14335] 1 exiting: rc = 0 00000100:00100000:2.0:1789498891.651396:0:14334:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff98eabb2f8800:14334] 0 exiting: rc = 1 00000100:00100000:0.0:1789498891.651496:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651504:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651511:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651517:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651523:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651529:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651534:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651540:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651545:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651550:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651556:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651561:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651636:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651644:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651649:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651655:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651660:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651665:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651670:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651676:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651697:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651703:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651709:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651716:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651722:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651728:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651733:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651739:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651745:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651751:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651756:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651762:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651766:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651771:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651777:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651782:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651788:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651793:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651799:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651805:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651811:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651816:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651877:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651885:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651891:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651896:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651901:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651906:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651911:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651919:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651924:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651929:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651935:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651941:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651946:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651960:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651964:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651970:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651976:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651983:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651988:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.651995:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.652000:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.652007:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498891.652991:0:14336:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff98ea847f8800:14336] 0 exiting: rc = 1 00000100:00100000:0.0:1789498891.653359:0:14337:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff98ea847f9c00:14337] 1 exiting: rc = 0 00000100:00100000:0.0:1789498891.653704:0:14338:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff98ea847f9800:14338] 2 exiting: rc = 0 00000100:00100000:0.0:1789498891.653783:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653792:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653798:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653806:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653813:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653819:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653899:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653906:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653912:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653918:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653924:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653934:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653939:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653946:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653951:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653958:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653981:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653989:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.653996:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654003:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654009:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654017:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654022:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654030:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654055:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654062:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654187:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654195:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654202:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654209:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654215:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654221:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654228:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654236:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654243:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654250:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654257:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654264:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654270:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654278:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654300:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654309:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654317:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654325:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654332:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654338:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654345:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654352:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654360:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654367:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654375:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654383:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654390:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654397:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654403:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654410:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654416:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654422:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654429:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654443:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654450:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654457:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654465:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498891.654472:0:22518:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789498891.665810:0:22518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498891.665830:0:22518:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789498891.665837:0:22518:0:(genops.c:885:class_export_put()) final put ffff98eaba12a800/MDS_uuid 00000020:00000080:0.0:1789498891.665843:0:22518:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba12a800/MDS_uuid for MDS 00000020:01000000:0.0:1789498891.665849:0:22518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789498891.666048:0:22518:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789498891.707990:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498892.716640:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498893.740301:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789498893.842059:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789498893.842076:0:6726:0:(genops.c:885:class_export_put()) final put ffff98ea88a95800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498893.842512:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea88a95800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789498893.842593:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea88a97800 for lustre-OST0000 00010000:00010000:0.0:1789498894.763512:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789498895.058042:0:22671:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789498895.082806:0:22671:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789498895.082856:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.082871:0:22671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.082879:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.082899:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.082960:0:22671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789498895.082968:0:22671:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789498895.083021:0:22671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498895.083026:0:22671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789498895.083033:0:22671:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498895.083039:0:22671:0:(import.c:65:import_set_state_nolock()) ffff98e987722800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789498895.083045:0:22671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498895.083047:0:22671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789498895.083051:0:22671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789498895.084181:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.084195:0:22671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.084202:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498895.084209:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498895.085845:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498895.085979:0:22671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498895.086199:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498895.086212:0:22671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498895.086219:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498895.086226:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086557:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498895.086565:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086584:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddee00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498895.086589:0:15943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086599:0:15943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498895.086608:0:15943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498895.086637:0:15943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498895.086640:0:15943:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1789498895.086678:0:15943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086685:0:15943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498895.086720:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086728:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddee00/0x3a6cb1946bc192f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc192f9 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086744:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498895.086748:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086754:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498895.086757:0:15943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086763:0:15943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498895.086770:0:15943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498895.086775:0:15943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789498895.086777:0:15943:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789498895.086788:0:15943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086801:0:15943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498895.086809:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498895.086817:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498895.086818:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498895.086821:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498895.086844:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885695744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498895.086926:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498895.086984:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498895.086991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885695616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498895.087026:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498895.087060:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695744 00000100:00100000:2.0:1789498895.087069:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695744 00010000:00010000:1.0:1789498895.087776:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498895.087788:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498895.087792:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498895.087801:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498895.087808:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498895.087814:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789498895.087817:0:14311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789498895.087820:0:14311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789498895.087846:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498895.087867:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789498895.087972:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885695872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498895.088029:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789498895.088102:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498895.088110:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde200/0x3a6cb1946bc1931c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc19323 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498895.088123:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498895.088125:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498895.088127:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498895.088155:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695616 00000100:00100000:1.0:1789498895.088163:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695616 00000100:00100000:1.0:1789498895.088187:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885695872 00000100:00100000:1.0:1789498895.088189:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885695872 00000100:00100000:1.0:1789498895.088201:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498895.088209:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1876424885695744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789498895.088216:0:14309:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789498895 with bad export cookie 4209935002705695173 00000100:00100000:2.0:1789498895.088427:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498895.088433:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876424885695616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789498895.088437:0:14308:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789498895 with bad export cookie 4209935002705695173 00000100:00100000:2.0:1789498895.088488:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876424885695616:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1460us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789498895.088505:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498895.088524:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498895.088528:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea87233c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1876424885695872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789498895.088532:0:14308:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789498895 with bad export cookie 4209935002705695173 00010000:00010000:0.0:1789498895.091040:0:22671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789498895.091060:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac1e00400/0x3a6cb1946bc195f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3a6cb1946bc195fb expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498895.091084:0:22671:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789498895.091111:0:22671:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1789498895.091114:0:22671:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789498895.091171:0:22671:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789498895.091196:0:22671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1789498895.091220:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789498895.091231:0:22671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498895.091239:0:22671:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789498895.091244:0:22671:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff98eabb558000) has no exports 00000020:00080000:0.0:1789498895.091979:0:22671:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff98eabb558000) has no exports 00000020:01000000:0.0:1789498895.096931:0:22671:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea87f51720 - data ffff98eab8314288/ffff98e9862ed800 00000100:00100000:2.0:1789498895.097279:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea87233c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1876424885695872:12345-0@lo:103:ldlm_bl.0 Request processed in 8741us (9241us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789498895.097296:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789498895.097406:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789498895.097412:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98ea88849000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789498895.097416:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1789498895.097688:0:22671:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea83540360 - data ffff98ea9c825510/ffff98eab8997800 00000100:00080000:3.0:1789498895.101280:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1789498895.103704:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1876424885695744:12345-0@lo:103:ldlm_bl.0 Request processed in 15490us (16774us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789498895.103718:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789498895.128736:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789498895.128743:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789498895.128754:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98ea864d1c00 x1876424885695744/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789498911 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498895.128766:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98ea864d0a80 x1876424885695616/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789498911 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498895.128774:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eabd541f80 x1876424885695872/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789498911 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498895.129086:0:3305:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98ea88849000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:2.0:1789498895.129410:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789498895.129415:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789498895.129416:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789498895.129423:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98ea88849000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498895.129430:0:3308:0:(import.c:545:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1789498895.129453:0:3308:0:(import.c:666:import_select_connection()) MGC192.168.201.120@tcp: import ffff98ea88849000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498895.129520:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea864d2a00 x1876424885696000/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498895.129668:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1cf59db6-3bc5-4ded-8751-c46e361eaced:3304:1876424885696000:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1789498895.129719:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424885696000 offset 0 length 520: 4 00000100:00100000:2.0:1789498895.129796:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885695744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498895.129823:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1cf59db6-3bc5-4ded-8751-c46e361eaced:3308:1876424885695616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498895.130978:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1cf59db6-3bc5-4ded-8751-c46e361eaced:3305:1876424885695872:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1789498895.139060:0:22671:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789498895.167248:0:22671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19307 00000020:00000080:2.0:1789498895.167260:0:22671:0:(genops.c:885:class_export_put()) final put ffff98eabd51b000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789498895.167276:0:22671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e98441a800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789498895.167279:0:22671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e98441a800 2 00000020:01000004:2.0:1789498895.167283:0:22671:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e98441a800 from lustre-OST0000 00000020:00000080:0.0:1789498895.167388:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabd51b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789498895.167421:0:22671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498895.167444:0:22671:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789498895.167447:0:22671:0:(genops.c:885:class_export_put()) final put ffff98eac1bb8000/lustre-OST0000_UUID 00000020:00000080:2.0:1789498895.167449:0:22671:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac1bb8000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789498895.167455:0:22671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789498895.167638:0:22671:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789498895.167643:0:22671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789498895.167648:0:22671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498895.167652:0:22671:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789498895.167659:0:22671:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98e987720000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498895.167665:0:22671:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff98eabb55cd40) has exports, disconnecting them 00000020:00080000:2.0:1789498895.167670:0:22671:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98e987720000), last request at 1789498612 00000020:00000080:2.0:1789498895.167677:0:22671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19331 00000020:00080000:2.0:1789498895.167686:0:22671:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e987720000): rc 0 00000020:00000080:2.0:1789498895.167691:0:22671:0:(genops.c:885:class_export_put()) final put ffff98e987720000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789498895.167776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e987720000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789498895.171173:0:22671:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789498895.171184:0:22671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498895.171189:0:22671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789498895.171197:0:22671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789498895.171232:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e987722800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789498895.171433:0:22671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498895.171443:0:22671:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789498895.171453:0:22671:0:(genops.c:885:class_export_put()) final put ffff98eabd51a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789498895.171457:0:22671:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabd51a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789498895.171468:0:22671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1789498895.171543:0:22671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e98441a800 1 00000020:00000080:3.0:1789498895.171550:0:22671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc192d6 00000020:00000080:3.0:1789498895.171557:0:22671:0:(genops.c:885:class_export_put()) final put ffff98eac0ae3000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789498895.171569:0:22671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789498895.171573:0:22671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498895.171578:0:22671:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789498895.171582:0:22671:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98e98443b380) has no exports 00000020:00000080:0.0:1789498895.171646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0ae3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789498895.203153:0:22671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498895.203171:0:22671:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789498895.203177:0:22671:0:(genops.c:885:class_export_put()) final put ffff98e98441d000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789498895.203182:0:22671:0:(genops.c:844:class_export_destroy()) destroying export ffff98e98441d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789498895.203195:0:22671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789498895.203367:0:22671:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e98441b000 00000020:02000400:3.0:1789498895.203411:0:22671:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789498895.789649:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498896.363197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1cf59db6-3bc5-4ded-8751-c46e361eaced->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789498896.363207:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1cf59db6-3bc5-4ded-8751-c46e361eaced->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498896.363210:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789498896.363214:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789498896.363219:0:38:0:(import.c:65:import_set_state_nolock()) ffff98e9877b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498896.363227:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 791 00000100:00080000:3.0:1789498896.363232:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789498896.363247:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e9877b5000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498896.363292:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9fa1500 x1876424885696128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498896.363407:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885696128:0@lo:38:kworker.0 00000400:00000100:0.0:1789498896.363486:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424885696128 offset 0 length 520: 4 00010000:00010000:1.0:1789498896.815927:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498897.839115:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789498898.253771:0:22820:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789498898.282380:0:22820:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789498898.282611:0:22820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498898.282628:0:22820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498898.282636:0:22820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498898.282643:0:22820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498898.282668:0:22820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789498898.282674:0:22820:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789498898.282696:0:22820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498898.282707:0:22820:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eab9fa1500 x1876424885696128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498911 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498898.282793:0:22820:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789498898.282801:0:22820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498898.282807:0:22820:0:(import.c:65:import_set_state_nolock()) ffff98e9877b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789498898.282812:0:22820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498898.282817:0:22820:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98eab9fa1500 x1876424885696128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498911 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498898.282824:0:22820:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789498898.282827:0:22820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1789498898.282886:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498898.282894:0:15943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498898.282902:0:15943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf200 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498898.282906:0:15943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498898.282930:0:15943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498898.282938:0:15943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498898.282944:0:15943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789498898.282957:0:15943:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789498898.282960:0:15943:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789498898.282975:0:15943:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea88849000 00010000:00010000:1.0:1789498898.282979:0:15943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498898.282985:0:15943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddf200/0x3a6cb1946bc19457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc1945e expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498898.282995:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498898.282997:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498898.282999:0:15943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498898.283637:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885696128:0@lo:38:kworker.0 00010000:00010000:2.0:1789498898.291643:0:22820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291665:0:22820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291672:0:22820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291681:0:22820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291708:0:22820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498898.291716:0:22820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291756:0:22820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291761:0:22820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291767:0:22820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.291789:0:22820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789498898.291794:0:22820:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789498898.291823:0:22820:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789498898.291829:0:22820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789498898.291833:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498898.291839:0:22820:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789498898.291844:0:22820:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff98ea83f2b380) has no exports 00000020:00080000:2.0:1789498898.291869:0:22820:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff98ea83f2b380) has no exports 00010000:00010000:0.0:1789498898.292808:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498898.292817:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292826:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91e00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498898.292829:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292853:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498898.292861:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498898.292867:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498898.292870:0:14312:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789498898.292872:0:14312:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789498898.292887:0:14312:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea88849000 00010000:00010000:0.0:1789498898.292891:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292898:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad91e00/0x3a6cb1946bc1942d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc19434 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292914:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498898.292918:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292924:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01400 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498898.292928:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292934:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498898.292940:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498898.292964:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789498898.292966:0:14312:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789498898.292968:0:14312:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789498898.292974:0:14312:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea88849000 00010000:00010000:0.0:1789498898.292977:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292983:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac1e01400/0x3a6cb1946bc195e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc195ed expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498898.292996:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498898.292998:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498898.293000:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789498898.295141:0:22820:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98ea87f51600 - data ffff98ea8aac5d80/ffff98e9862efc00 00000020:01000000:2.0:1789498898.295326:0:22820:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e9852e03c0 - data ffff98ea821daa20/ffff98e986aaec00 00010000:00010000:3.0:1789498898.295586:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789498898.305733:0:22820:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789498898.365498:0:22820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19442 00000020:00000080:2.0:1789498898.365511:0:22820:0:(genops.c:885:class_export_put()) final put ffff98e9877b7800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789498898.365532:0:22820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98eabfb3d800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789498898.365536:0:22820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eabfb3d800 2 00000020:01000004:2.0:1789498898.365539:0:22820:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98eabfb3d800 from lustre-OST0001 00000020:00000080:2.0:1789498898.365571:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498898.365582:0:22820:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789498898.365584:0:22820:0:(genops.c:885:class_export_put()) final put ffff98eabfb3e000/lustre-OST0001_UUID 00000020:00000080:2.0:1789498898.365588:0:22820:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabfb3e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789498898.365607:0:22820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789498898.365701:0:22820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1cf59db6-3bc5-4ded-8751-c46e361eaced->MGS 00010000:00010000:2.0:1789498898.365729:0:22820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498898.365741:0:22820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498898.365748:0:22820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789498898.365750:0:22820:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789498898.365753:0:22820:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789498898.365770:0:22820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea88849000 00010000:00010000:2.0:1789498898.365773:0:22820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddf600/0x3a6cb1946bc192e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc192eb expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498898.365786:0:22820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498898.365792:0:22820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498898.365797:0:22820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498898.365799:0:22820:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789498898.365800:0:22820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789498898.365810:0:22820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98ea88849000 00010000:00010000:2.0:1789498898.365813:0:22820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabad90c00/0x3a6cb1946bc191cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3a6cb1946bc191d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789498898.365831:0:22820:0:(import.c:65:import_set_state_nolock()) ffff98ea88849000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789498898.365835:0:22820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789498898.365838:0:22820:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789498898.365845:0:22820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789498898.365849:0:22820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789498898.365863:0:22820:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98ea864d2a00 x1876424885696000/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789498905 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789498898.365874:0:22820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789498898.365878:0:22820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1789498898.365972:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1cf59db6-3bc5-4ded-8751-c46e361eaced:3304:1876424885696000:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1789498898.366063:0:22820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789498898.366071:0:22820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc191b7 00000020:00000080:2.0:1789498898.366076:0:22820:0:(genops.c:885:class_export_put()) final put ffff98eaba12f800/1cf59db6-3bc5-4ded-8751-c46e361eaced 00000020:01000000:2.0:1789498898.366082:0:22820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.120@tcp (flags='') 00000020:00000080:2.0:1789498898.366129:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498898.366135:0:22820:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789498898.366139:0:22820:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff98e98443cd40) has no exports 00000020:00000080:0.0:1789498898.366196:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e9877b7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789498898.366209:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98eaba12f800/1cf59db6-3bc5-4ded-8751-c46e361eaced for MGC192.168.201.120@tcp 10000000:01000000:1.0:1789498898.366411:0:14320:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789498898.366642:0:22820:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.120@tcp: client import never connected 00000100:00080000:2.0:1789498898.366645:0:22820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789498898.366649:0:22820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789498898.366651:0:22820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789498898.366653:0:22820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789498898.366739:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498898.366744:0:22820:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.120@tcp (uuid 1cf59db6-3bc5-4ded-8751-c46e361eaced) 00000020:01000000:2.0:1789498898.366750:0:22820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789498898.366753:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498898.366757:0:22820:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789498898.366762:0:22820:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98e9877b3800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498898.366767:0:22820:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff98ea83f2cd40) has exports, disconnecting them 00000020:00080000:2.0:1789498898.366771:0:22820:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98e9877b3800), last request at 1789498630 00000020:00000080:2.0:1789498898.366775:0:22820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc1946c 00000020:00080000:2.0:1789498898.366787:0:22820:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e9877b3800): rc 0 00000020:00000080:2.0:1789498898.366791:0:22820:0:(genops.c:885:class_export_put()) final put ffff98e9877b3800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789498898.370125:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98ea88849000 for MGC192.168.201.120@tcp 00000020:00000080:0.0:1789498898.370146:0:38:0:(genops.c:885:class_export_put()) final put ffff98ea8884d800/1cf59db6-3bc5-4ded-8751-c46e361eaced 00000020:00000080:0.0:1789498898.370150:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ea8884d800/1cf59db6-3bc5-4ded-8751-c46e361eaced for MGC192.168.201.120@tcp 00000020:01000000:0.0:1789498898.370158:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.120@tcp (1cf59db6-3bc5-4ded-8751-c46e361eaced) 00000020:00000080:0.0:1789498898.372326:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e9877b3800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789498898.373149:0:22820:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789498898.373157:0:22820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789498898.373162:0:22820:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789498898.373169:0:22820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789498898.373307:0:15943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1789498898.373467:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98e9877b5000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789498898.373557:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789498898.373882:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789498898.374118:0:14306:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98ea87005800:14306] 0 exiting: rc = 1 00000100:00100000:1.0:1789498898.374175:0:14307:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98eaba7ebe00:14307] 1 exiting: rc = 0 00000100:00100000:0.0:1789498898.374502:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.375463:0:14308:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98ea87004200:14308] 0 exiting: rc = 1 00000100:00100000:1.0:1789498898.375548:0:14309:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98ea8574a000:14309] 1 exiting: rc = 0 00000100:00100000:1.0:1789498898.446891:0:14310:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98ea8574ae00:14310] 2 exiting: rc = 0 00000100:00100000:1.0:1789498898.447046:0:16441:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98e984dc9c00:16441] 3 exiting: rc = 0 00000100:00100000:0.0:1789498898.447321:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447332:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447342:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447374:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447380:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447388:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447395:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447415:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447422:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447429:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447435:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447441:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447446:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447451:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447458:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447464:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447470:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447476:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447482:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447488:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447493:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447500:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447505:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447511:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447517:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447523:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447530:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447536:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447541:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447547:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447552:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447558:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447562:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447567:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447573:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447579:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447584:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447590:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447604:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447610:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447615:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447621:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447627:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447632:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447638:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447643:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447647:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447652:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447659:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447664:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447669:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447674:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447679:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447684:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447690:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447695:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447700:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447705:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447711:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447728:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447735:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447740:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447745:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.447750:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789498898.449161:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498898.449172:0:22820:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789498898.449179:0:22820:0:(genops.c:885:class_export_put()) final put ffff98e9877b5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789498898.449184:0:22820:0:(genops.c:844:class_export_destroy()) destroying export ffff98e9877b5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789498898.449195:0:22820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789498898.449239:0:22820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98eabfb3d800 1 00000020:00000080:0.0:1789498898.449246:0:22820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3a6cb1946bc19426 00000020:00000080:0.0:1789498898.449252:0:22820:0:(genops.c:885:class_export_put()) final put ffff98eac1bbb800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789498898.449278:0:22820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789498898.449283:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498898.449288:0:22820:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789498898.449291:0:22820:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff98ea83f299c0) has no exports 00000020:00000080:1.0:1789498898.449771:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac1bbb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789498898.488758:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498898.488779:0:22820:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789498898.488786:0:22820:0:(genops.c:885:class_export_put()) final put ffff98eabfb38800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789498898.488792:0:22820:0:(genops.c:844:class_export_destroy()) destroying export ffff98eabfb38800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789498898.488805:0:22820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789498898.489011:0:22820:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98eabfb3c800 00000020:01000000:0.0:1789498898.489037:0:22820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789498898.489041:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498898.489047:0:22820:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789498898.489051:0:22820:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff98eabb55b380) has no exports 00000020:00000080:0.0:1789498898.489071:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498898.489077:0:22820:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789498898.489080:0:22820:0:(genops.c:885:class_export_put()) final put ffff98eac0ae2800/OSS_uuid 00000020:00000080:0.0:1789498898.489082:0:22820:0:(genops.c:844:class_export_destroy()) destroying export ffff98eac0ae2800/OSS_uuid for OSS 00000020:01000000:0.0:1789498898.489086:0:22820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789498898.489140:0:14319:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789498898.491461:0:15006:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff98eaba89d600:15006] 0 exiting: rc = 1 00000100:00100000:1.0:1789498898.494178:0:15007:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff98eaa1e7ea00:15007] 1 exiting: rc = 0 00000100:00100000:1.0:1789498898.494330:0:16608:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff98ea87e35800:16608] 3 exiting: rc = 0 00000100:00100000:1.0:1789498898.494502:0:15008:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff98eaa1e7fa00:15008] 2 exiting: rc = 0 00000100:00100000:0.0:1789498898.497684:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497696:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497703:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497710:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497717:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497723:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497730:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497736:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497743:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497749:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497755:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497762:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497767:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497794:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497800:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497806:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497811:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497816:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497822:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497827:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497834:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497840:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497845:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497850:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497855:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497861:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497866:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497871:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497876:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497881:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497886:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497890:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497895:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497902:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497907:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497912:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497917:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497923:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497928:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497933:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497939:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497957:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497964:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497969:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497976:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497982:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497988:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.497995:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498009:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498018:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498023:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498031:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498037:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498043:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498049:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498059:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498065:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498071:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498077:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498083:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498106:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498113:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498119:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.498125:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500137:0:15011:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98eaa9083200:15011] 1 exiting: rc = 0 00000100:00100000:1.0:1789498898.500287:0:15010:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98eaa9082c00:15010] 0 exiting: rc = 1 00000100:00100000:0.0:1789498898.500766:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500777:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500783:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500788:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500793:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500799:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500805:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500810:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500816:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500823:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500830:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500835:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500841:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500861:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500869:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500874:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500879:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500884:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500903:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500908:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500913:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500917:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500922:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500927:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500932:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500937:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500953:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500959:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500965:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500971:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500976:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500982:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500991:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.500998:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501004:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501009:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501014:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501020:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501026:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501031:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501037:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501042:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501049:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501057:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501063:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501070:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501075:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501080:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501086:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501126:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501131:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501136:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501141:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501154:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501163:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501168:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501174:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501179:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501185:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501190:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501195:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501199:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501205:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.501217:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.503377:0:15014:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98eaa9083600:15014] 2 exiting: rc = 0 00000100:00100000:0.0:1789498898.503792:0:15013:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98e98574c000:15013] 1 exiting: rc = 0 00000100:00100000:2.0:1789498898.505336:0:15012:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98eaa9083400:15012] 0 exiting: rc = 1 00000100:00100000:0.0:1789498898.505416:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505424:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505430:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505503:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505509:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505515:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505521:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505527:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505532:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505538:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505544:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505549:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505554:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505559:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505565:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505570:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505576:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505582:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505587:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505593:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505612:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505620:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505626:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505645:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505650:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505656:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505661:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505667:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505673:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505678:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505683:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505690:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505700:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505705:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505711:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505847:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505857:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505863:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505869:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505874:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505880:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505885:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505891:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505896:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505917:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505924:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505930:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505936:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505950:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505957:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505964:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505970:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505976:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505982:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505989:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.505995:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506001:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506006:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506022:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506029:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506036:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506054:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506062:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498898.506070:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.522615:0:15015:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98eaba9b0800:15015] 0 exiting: rc = 1 00000100:00100000:0.0:1789498898.525799:0:15016:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98eaba1e3800:15016] 1 exiting: rc = 0 00000100:00100000:1.0:1789498898.526006:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526015:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526025:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526031:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526037:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526046:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526053:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526060:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526068:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526073:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526079:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526085:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526116:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526122:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526127:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526133:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526138:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526143:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526150:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526156:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526161:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526167:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526190:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526195:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526200:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526206:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526241:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526247:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526254:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526260:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526265:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526270:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526277:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526282:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526288:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526293:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526298:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526303:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526309:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526315:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526321:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526326:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526357:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526363:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526369:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526375:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526380:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526386:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526392:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526399:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526419:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526428:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526442:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526448:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526453:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526459:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526464:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526476:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526481:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526487:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526493:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526498:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526503:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.526515:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.528312:0:15018:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98ea9f76fe00:15018] 1 exiting: rc = 0 00000100:00100000:0.0:1789498898.531138:0:15017:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98ea9f76e000:15017] 0 exiting: rc = 1 00000100:00100000:1.0:1789498898.535697:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535712:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535720:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535727:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535733:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535739:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535747:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535788:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535796:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535802:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535809:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535816:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535823:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535829:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535834:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535841:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535846:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535852:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535859:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535880:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535887:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535893:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535899:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535906:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535912:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535918:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535924:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535960:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535966:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535972:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.535979:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536000:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536008:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536013:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536020:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536026:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536032:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536038:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536044:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536051:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536056:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536062:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536069:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536113:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536121:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536127:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536134:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536140:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536145:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536151:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536157:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536164:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536172:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536179:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536186:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536206:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536212:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536218:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536224:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536231:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536238:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536243:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536255:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498898.536261:0:22820:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789498898.564965:0:22820:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789498917.360796:0:23439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789498927.579519:0:23899:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789498927.579524:0:23899:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789498927.579640:0:23899:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e9852f1000 00000020:01000004:1.0:1789498927.579654:0:23899:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789498927.579662:0:23899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789498927.579678:0:23899:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98eabb55b380) 00000020:00000080:1.0:1789498927.579691:0:23899:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789498927.592529:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789498927.594364:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1789498927.594695:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 512: rc = 0 00100000:10000000:0.0:1789498927.594912:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 512: rc = 0 00100000:10000000:0.0:1789498927.594997:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:0.0:1789498927.595086:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 512: rc = 0 00100000:10000000:0.0:1789498927.595635:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789498927.595705:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 512: rc = 0 00100000:10000000:0.0:1789498927.595918:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:0.0:1789498927.596239:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 514: rc = 0 00100000:10000000:0.0:1789498927.597511:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 389: rc = 0 00100000:10000000:0.0:1789498927.597640:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 389: rc = 0 00100000:10000000:0.0:1789498927.598500:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1789498927.598872:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 397: rc = 0 00100000:10000000:0.0:1789498927.599171:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 397: rc = 0 00100000:10000000:0.0:1789498927.599418:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1789498927.599680:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 397: rc = 0 00100000:10000000:0.0:1789498927.599943:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1789498927.600185:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1789498927.600431:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 397: rc = 0 00100000:10000000:0.0:1789498927.600946:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1789498927.601218:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 397: rc = 0 00100000:10000000:0.0:1789498927.601489:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 397: rc = 0 00100000:10000000:0.0:1789498927.601779:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1789498927.602218:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 660: rc = 0 00100000:10000000:0.0:1789498927.602525:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 660: rc = 0 00100000:10000000:0.0:1789498927.602897:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 660: rc = 0 00100000:10000000:0.0:1789498927.603067:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 660: rc = 0 00100000:10000000:0.0:1789498927.603416:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 660: rc = 0 00100000:10000000:0.0:1789498927.603769:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 660: rc = 0 00100000:10000000:0.0:1789498927.603988:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 660: rc = 0 00100000:10000000:0.0:1789498927.604254:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 660: rc = 0 00100000:10000000:0.0:1789498927.604503:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 660: rc = 0 00100000:10000000:0.0:1789498927.604837:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 660: rc = 0 00100000:10000000:0.0:1789498927.605011:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 660: rc = 0 00100000:10000000:0.0:1789498927.605345:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 660: rc = 0 00100000:10000000:0.0:1789498927.605525:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 660: rc = 0 00100000:10000000:0.0:1789498927.605862:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 660: rc = 0 00100000:10000000:0.0:1789498927.606067:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 660: rc = 0 00100000:10000000:0.0:1789498927.606482:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 660: rc = 0 00100000:10000000:0.0:1789498927.606925:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 660: rc = 0 00100000:10000000:0.0:1789498927.607332:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 660: rc = 0 00100000:10000000:0.0:1789498927.607668:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 660: rc = 0 00100000:10000000:0.0:1789498927.607954:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 660: rc = 0 00100000:10000000:0.0:1789498927.608287:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 660: rc = 0 00100000:10000000:0.0:1789498927.608515:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 660: rc = 0 00100000:10000000:0.0:1789498927.608903:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 660: rc = 0 00100000:10000000:0.0:1789498927.609076:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 660: rc = 0 00100000:10000000:0.0:1789498927.609364:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 660: rc = 0 00100000:10000000:0.0:1789498927.609579:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 660: rc = 0 00100000:10000000:0.0:1789498927.609917:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 660: rc = 0 00100000:10000000:0.0:1789498927.610087:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 660: rc = 0 00100000:10000000:0.0:1789498927.610349:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 660: rc = 0 00100000:10000000:0.0:1789498927.610697:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 660: rc = 0 00100000:10000000:0.0:1789498927.610967:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 660: rc = 0 00100000:10000000:0.0:1789498927.611206:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 660: rc = 0 00100000:10000000:0.0:1789498927.611862:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 773: rc = 0 00100000:10000000:0.0:1789498927.612445:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789498927.612700:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 393: rc = 0 00100000:10000000:0.0:1789498927.612979:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789498927.613020:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 393: rc = 0 00100000:10000000:0.0:1789498927.613188:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789498927.613253:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 393: rc = 0 00100000:10000000:0.0:1789498927.613717:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1789498927.613977:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 390: rc = 0 00100000:10000000:0.0:1789498927.614216:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1789498927.614396:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 390: rc = 0 00100000:10000000:0.0:1789498927.614704:0:23899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1789498927.614897:0:23899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 390: rc = 0 00000020:00000080:0.0:1789498927.615210:0:23899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789498927.615217:0:23899:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789498927.615232:0:23899:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19bd5 00000020:01000004:0.0:1789498927.615239:0:23899:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789498927.615245:0:23899:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789498927.615250:0:23899:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e9852f1000 from MGS 00000020:01000004:0.0:1789498927.615253:0:23899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789498927.615337:0:23899:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98e98443cd40) 00000020:00000080:0.0:1789498927.615347:0:23899:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789498927.615403:0:23899:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e9852f1000 from MGS, refs=2 00080000:01000000:0.0:1789498927.615407:0:23899:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789498927.615411:0:23899:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19be3 00000100:00100000:0.0:1789498927.615515:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789498927.615663:0:23899:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789498927.615670:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789498927.616431:0:23899:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789498927.616438:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789498927.617486:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498927.617718:0:23899:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789498927.617843:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789498927.618487:0:23899:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789498927.618494:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789498927.618964:0:23899:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789498927.618970:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789498927.619909:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498927.619912:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498927.619915:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498927.620375:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498927.620378:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498927.620380:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498927.620847:0:23899:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789498927.623249:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789498927.627902:0:23899:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789498927.627924:0:23899:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789498927.627926:0:23899:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789498927.631108:0:23909:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789498927.631375:0:23899:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789498927.631503:0:23899:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789498927.632391:0:23899:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789498927.632756:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498927.633170:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789498927.633177:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789498927.633621:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789498927.633627:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789498927.634319:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789498927.634327:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789498927.635069:0:23899:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789498927.635107:0:23899:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.120@tcp' 00000020:01000004:2.0:1789498927.635109:0:23899:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789498927.635145:0:23899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.120@tcp (typ=mgc) 00000020:00000080:2.0:1789498927.635159:0:23899:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.120@tcp (ffff98e985268000) 00000020:00000080:2.0:1789498927.635176:0:23899:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789498927.635243:0:23899:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e985566000@MGC192.168.201.120@tcp: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1789498927.635378:0:23899:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.120@tcp-0 is initialized 00000040:01000000:2.0:1789498927.635384:0:23899:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789498927.636069:0:23913:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789498927.636183:0:23914:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789498927.636273:0:23899:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.120@tcp (uuid 8f836406-9642-48a3-887d-ecfcbfd0595e) 00000020:00000080:2.0:1789498927.636291:0:23899:0:(genops.c:1384:class_connect()) connect: client 8f836406-9642-48a3-887d-ecfcbfd0595e, cookie 0x3a6cb1946bc19bf1 00000100:00080000:2.0:1789498927.636303:0:23899:0:(import.c:545:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498927.636313:0:23899:0:(import.c:666:import_select_connection()) MGC192.168.201.120@tcp: import ffff98e985566000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498927.636352:0:23899:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea864d0a80 x1876424885696256/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498927.636414:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8f836406-9642-48a3-887d-ecfcbfd0595e:3304:1876424885696256:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789498927.636487:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.636598:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885696256 00000100:00100000:0.0:1789498927.636607:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885696256 00000100:00100000:0.0:1789498927.636640:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498927.636647:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876424885696256:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789498927.636672:0:23910:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8f836406-9642-48a3-887d-ecfcbfd0595e@0@lo t0 exp 0000000000000000 cur 827 last 0 00000020:00000080:0.0:1789498927.636694:0:23910:0:(genops.c:1384:class_connect()) connect: client 8f836406-9642-48a3-887d-ecfcbfd0595e, cookie 0x3a6cb1946bc19bf8 00000100:00080000:0.0:1789498927.636883:0:23910:0:(import.c:65:import_set_state_nolock()) ffff98eac1d9b000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789498927.637011:0:23899:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8f836406-9642-48a3-887d-ecfcbfd0595e->MGS 00000020:01000004:2.0:1789498927.637030:0:23899:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789498927.637058:0:23899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789498927.637071:0:23899:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98e98526b380) 00000020:00000080:2.0:1789498927.637081:0:23899:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789498927.642023:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+5:3304:x1876424885696256:12345-0@lo:250:mount.lustre.0 Request processed in 5361us (5521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.642050:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498927.642240:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789498927.642258:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:1.0:1789498927.642269:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789498927.642275:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789498927.642281:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98e985566000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789498927.642284:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789498927.642301:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789498927.642308:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8f836406-9642-48a3-887d-ecfcbfd0595e:3304:1876424885696256:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789498927.645679:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498927.646009:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789498927.646015:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789498927.646848:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789498927.646855:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789498927.649027:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789498927.649039:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789498927.649719:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498927.649971:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789498927.649975:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789498927.650856:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789498927.650864:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789498927.680834:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498927.681065:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789498927.681070:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789498927.682402:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789498927.682411:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789498927.683057:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498927.683249:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789498927.683255:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789498927.683978:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789498927.683984:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789498927.684450:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498927.684568:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789498927.684574:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789498927.685002:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789498927.685007:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789498927.685434:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498927.685523:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789498927.685525:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789498927.685835:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789498927.685839:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789498927.698467:0:23899:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498927.699052:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789498927.699058:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789498927.700339:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789498927.700353:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789498927.700903:0:23899:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789498927.700979:0:23899:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789498927.702023:0:23899:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789498927.702054:0:23899:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789498927.702062:0:23899:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789498927.702361:0:23899:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789498927.702407:0:23899:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789498927.702413:0:23899:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789498927.702414:0:23899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498927.702416:0:23899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498927.702417:0:23899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498927.702418:0:23899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498927.702434:0:23899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498927.702435:0:23899:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498927.702436:0:23899:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498927.702438:0:23899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498927.702440:0:23899:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498927.702442:0:23899:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789498927.702444:0:23899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498927.702446:0:23899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498927.702447:0:23899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498927.702448:0:23899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498927.702449:0:23899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498927.702450:0:23899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498927.702451:0:23899:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498927.702452:0:23899:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498927.702454:0:23899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498927.702455:0:23899:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498927.702484:0:23899:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789498927.702503:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498927.702571:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.702650:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.702693:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885696384 00000100:00100000:1.0:1789498927.702702:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885696384 00000100:00100000:1.0:1789498927.702768:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498927.702776:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+5:23899:x1876424885696384:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789498927.702825:0:23912:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789498927.702828:0:23912:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789498927.702831:0:23912:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789498927.703480:0:23933:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789498927.703993:0:23912:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1789498927.704970:0:23934:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789498927.704974:0:23934:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789498927.704976:0:23934:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789498927.705000:0:23934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789498927.705395:0:23912:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789498927.705408:0:23912:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789498927.710475:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+5:23899:x1876424885696384:12345-0@lo:253:mount.lustre.0 Request processed in 7690us (7895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.710488:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498927.710595:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498927.710611:0:23899:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789498927.710615:0:23899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498927.710616:0:23899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789498927.710618:0:23899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498927.710619:0:23899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498927.710620:0:23899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498927.710622:0:23899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498927.710623:0:23899:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789498927.710625:0:23899:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789498927.710627:0:23899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498927.710629:0:23899:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789498927.710648:0:23899:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e9852f1000 from lustre-MDT0000 10000000:01000000:3.0:1789498927.710672:0:23899:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789498927.710675:0:23899:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789498927.710679:0:23899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98e985268000 10000000:01000000:3.0:1789498927.710683:0:23899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498927.710691:0:23899:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e985268000 from 1 10000000:01000000:3.0:1789498927.710695:0:23899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789498927.710732:0:23899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.710743:0:23899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.710753:0:23899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.710773:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498927.710882:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.710918:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498927.710979:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885696512 00000100:00100000:0.0:1789498927.710985:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885696512 00000100:00100000:0.0:1789498927.711054:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498927.711063:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+5:23899:x1876424885696512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498927.711075:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498927.711108:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc19c0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19c06 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.711132:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc19c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19c06 expref: 6 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.711143:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa5800/0x3a6cb1946bc19c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19c06 expref: 6 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.711152:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5800, rc 0) 00000100:00100000:0.0:1789498927.711193:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+6:23899:x1876424885696512:12345-0@lo:101:mount.lustre.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.711198:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498927.711258:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.711283:0:23899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.711292:0:23899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.711339:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498927.711362:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.711523:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.711621:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885696640 00000100:00100000:1.0:1789498927.711626:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885696640 00000100:00100000:1.0:1789498927.711648:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498927.711654:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+6:23899:x1876424885696640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498927.711888:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+6:23899:x1876424885696640:12345-0@lo:501:mount.lustre.0 Request processed in 233us (524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498927.711896:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498927.712020:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696640:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789498927.712043:0:23899:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789498927.712063:0:23899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712072:0:23899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498927.712080:0:23899:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e9852f1000 10000000:01000000:3.0:1789498927.712085:0:23899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789498927.712119:0:23899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98e9852f1000 10000000:01000000:3.0:1789498927.712123:0:23899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789498927.712126:0:23899:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98e9852f1000 from 1 10000000:01000000:3.0:1789498927.712128:0:23899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789498927.712148:0:23899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712155:0:23899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712173:0:23899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.712187:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498927.712212:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.712225:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.712302:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885696768 00000100:00100000:1.0:1789498927.712306:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885696768 00000100:00100000:1.0:1789498927.712325:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498927.712332:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+6:23899:x1876424885696768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498927.712340:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498927.712350:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19c14 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.712367:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19c14 expref: 7 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.712375:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e01000/0x3a6cb1946bc19c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19c14 expref: 7 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.712381:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01000, rc 0) 00000100:00100000:1.0:1789498927.712407:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+7:23899:x1876424885696768:12345-0@lo:101:mount.lustre.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498927.712412:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498927.712500:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.712512:0:23899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c1b expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712519:0:23899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19c1b expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498927.712529:0:23899:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789498927.712542:0:23899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c1b expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712549:0:23899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddec00/0x3a6cb1946bc19c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c1b expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498927.712555:0:23899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789498927.712559:0:23899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498927.712563:0:23899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98e9852f1000 10000000:01000000:3.0:1789498927.712565:0:23899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789498927.712569:0:23899:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789498927.712570:0:23899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789498927.712583:0:23899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712595:0:23899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.712603:0:23899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.712614:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498927.712640:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.712658:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.712709:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885696896 00000100:00100000:1.0:1789498927.712713:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885696896 00000100:00100000:1.0:1789498927.712731:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498927.712736:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+7:23899:x1876424885696896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498927.712743:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498927.712750:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc19c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19c22 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.712762:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc19c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19c22 expref: 8 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.712770:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e01200/0x3a6cb1946bc19c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19c22 expref: 8 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.712776:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01200, rc 0) 00000100:00100000:1.0:1789498927.712915:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+8:23899:x1876424885696896:12345-0@lo:101:mount.lustre.0 Request processed in 177us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498927.712921:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498927.713239:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885696896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.713250:0:23899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c29 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.713259:0:23899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19c29 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.713305:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498927.713329:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.713383:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.713880:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885697024 00000100:00100000:1.0:1789498927.713887:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885697024 00000100:00100000:1.0:1789498927.713967:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498927.713976:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+8:23899:x1876424885697024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498927.714524:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23899:x1876424885697024:12345-0@lo:501:mount.lustre.0 Request processed in 548us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498927.714532:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498927.714928:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498927.714972:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498927.715022:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.715119:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.715187:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885697152 00000100:00100000:1.0:1789498927.715194:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885697152 00000100:00100000:1.0:1789498927.715223:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498927.715243:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23899:x1876424885697152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498927.715768:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498927.716027:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23899:x1876424885697152:12345-0@lo:503:mount.lustre.0 Request processed in 439us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498927.716037:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498927.716463:0:23935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23935:1876424885697280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498927.716506:0:23935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498927.716542:0:23935:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498927.716600:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885697280 00000100:00100000:3.0:1789498927.716610:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885697280 00000100:00100000:3.0:1789498927.716648:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498927.716656:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23935:x1876424885697280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498927.717115:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23935:x1876424885697280:12345-0@lo:502:llog_process_th.0 Request processed in 433us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498927.717121:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498927.717524:0:23935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23935:1876424885697280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498927.717552:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498927.717563:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.717565:0:23935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789498927.717571:0:23935:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789498927.717574:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498927.717589:0:23935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98eabb55cd40) 00000020:00000080:1.0:1789498927.717606:0:23935:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789498927.717611:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789498927.717912:0:23935:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789498927.717919:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19c37 00000020:00000080:1.0:1789498927.718440:0:23935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789498927.718446:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498927.718450:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.718452:0:23935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789498927.718455:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498927.718460:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.718461:0:23935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789498927.718464:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498927.718472:0:23935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98eabb558000) 00000020:00000080:1.0:1789498927.718483:0:23935:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789498927.718487:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789498927.718489:0:23935:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789498927.718498:0:23935:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789498927.718504:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789498927.718578:0:23935:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e9852f1000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789498927.718592:0:23935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98eabb5599c0) 00000020:00000080:1.0:1789498927.718601:0:23935:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789498927.718650:0:23935:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789498927.718658:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19c4c 00000020:00000080:1.0:1789498927.718944:0:23935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789498927.718951:0:23935:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789498927.718957:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3a6cb1946bc19c53 00080000:01000000:1.0:1789498927.718963:0:23935:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789498927.718967:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19c5a 00010000:00010000:0.0:1789498927.809748:0:23935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789498927.815022:0:23935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934675 00000001:00080000:2.0:1789498927.816401:0:23935:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789498927.820925:0:23935:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98e98526cd40) 00000020:00000080:2.0:1789498927.820957:0:23935:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789498927.821041:0:23935:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789498927.821050:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19c68 00000020:00000080:0.0:1789498927.825657:0:23935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789498927.835634:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3a6cb1946bc19c6f 00000020:00000080:0.0:1789498927.847872:0:23935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789498927.847897:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498927.847907:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.847909:0:23935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789498927.847918:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789498927.847922:0:23935:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789498927.847944:0:23935:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789498927.847946:0:23935:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789498927.847947:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789498927.847950:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.847952:0:23935:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789498927.847955:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498927.847962:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.847964:0:23935:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789498927.847970:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789498927.848041:0:23935:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789498927.848060:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498927.848064:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.848066:0:23935:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789498927.848070:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789498927.848074:0:23935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789498927.848078:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.848079:0:23935:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789498927.848082:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789498927.848118:0:23935:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1789498927.848158:0:23935:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789498927.848162:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789498927.848185:0:23935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98e9844399c0) 00000020:00000080:0.0:1789498927.848209:0:23935:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789498927.848215:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789498927.848508:0:23935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789498927.848516:0:23935:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789498927.848524:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19c7d 00010000:00080000:0.0:1789498927.848572:0:23935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea83f89000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1789498927.848918:0:23935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789498927.851967:0:23935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789498927.852040:0:23935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789498927.871528:0:23935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498927.871605:0:23935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789498927.871670:0:23935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1789498927.874349:0:23939:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789498927.874357:0:23939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789498927.876391:0:23935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789498927.876405:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789498927.876451:0:23935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789498927.876471:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19c84 00000100:00080000:2.0:1789498927.876481:0:23935:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498927.876493:0:23935:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98ea83f89000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498927.876530:0:23935:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea864d1c00 x1876424885697408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498927.876557:0:23935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789498927.876615:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498927.876620:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498927.876622:0:23935:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789498927.876625:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789498927.876628:0:23935:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789498927.876629:0:23935:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498927.876631:0:23935:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498927.876633:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789498927.876635:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498927.876643:0:23935:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789498927.876646:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789498927.876650:0:23935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789498927.876653:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498927.876655:0:23935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789498927.876658:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789498927.876661:0:23935:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1789498927.876692:0:23935:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789498927.876696:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498927.876708:0:23935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98e9852699c0) 00000020:00000080:2.0:1789498927.876720:0:23935:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789498927.876724:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1789498927.877030:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885697408:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789498927.877086:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885697408 offset 0 length 520: 4 00000004:00080000:0.0:1789498927.877535:0:23935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789498927.877551:0:23935:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789498927.877558:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3a6cb1946bc19c92 00010000:00080000:0.0:1789498927.877589:0:23935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea83f8b800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1789498927.877839:0:23935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789498927.878049:0:23935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789498927.878073:0:23935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789498927.878744:0:23935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498927.879976:0:23935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789498927.880109:0:23935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789498927.881151:0:23941:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789498927.881156:0:23941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789498927.882524:0:23935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498927.882539:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789498927.882577:0:23935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789498927.882600:0:23935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19c99 00000100:00080000:0.0:1789498927.882612:0:23935:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789498927.882625:0:23935:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea83f8b800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498927.882667:0:23935:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb40d500 x1876424885697536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498927.882859:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885697536:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789498927.882938:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885697536 offset 0 length 520: 4 00000100:00080000:0.0:1789498927.883003:0:23935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789498927.883066:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498927.883070:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.883071:0:23935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789498927.883075:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498927.883079:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.883080:0:23935:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789498927.883083:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789498927.883085:0:23935:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789498927.883117:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498927.883121:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.883122:0:23935:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789498927.883125:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498927.883127:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.883134:0:23935:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789498927.883139:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789498927.883168:0:23935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23935:1876424885697664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498927.883219:0:23935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.883255:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885697664 00000100:00100000:0.0:1789498927.883261:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885697664 00000100:00100000:0.0:1789498927.883298:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498927.883308:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23935:x1876424885697664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498927.883587:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23935:x1876424885697664:12345-0@lo:502:llog_process_th.0 Request processed in 280us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.883595:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498927.883634:0:23935:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498927.883656:0:23935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23935:1876424885697664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498927.883679:0:23935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498927.883695:0:23935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498927.883697:0:23935:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789498927.883702:0:23935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789498927.884080:0:23899:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789498927.884135:0:23899:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789498927.884154:0:23899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c29 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.884166:0:23899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde800/0x3a6cb1946bc19c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c29 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498927.884174:0:23899:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e9852f1000 from 1 10000000:01000000:3.0:1789498927.884177:0:23899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789498927.884207:0:23899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.884216:0:23899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.884226:0:23899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.884243:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498927.884276:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.884296:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498927.884652:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885697792 00000100:00100000:2.0:1789498927.884659:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885697792 00000100:00100000:2.0:1789498927.884708:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498927.884717:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+9:23899:x1876424885697792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498927.884726:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498927.884742:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19ca0 expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498927.884765:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 10 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498927.884775:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 10 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498927.884794:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadcce00, rc 0) 00000100:00100000:2.0:1789498927.884828:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+10:23899:x1876424885697792:12345-0@lo:101:mount.lustre.0 Request processed in 113us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498927.884843:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498927.885991:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.886022:0:23899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.886033:0:23899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.886626:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697920:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789498927.886692:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.886722:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498927.886944:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885697920 00000100:00100000:2.0:1789498927.886951:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885697920 00000100:00100000:2.0:1789498927.886999:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498927.887009:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+10:23899:x1876424885697920:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789498927.887028:0:23910:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789498927.887035:0:23910:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789498927.887359:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+10:23899:x1876424885697920:12345-0@lo:256:mount.lustre.0 Request processed in 351us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498927.887367:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498927.887454:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885697920:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789498927.888069:0:23899:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789498927.888286:0:23899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.888300:0:23899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498927.888310:0:23899:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e9852f1000 from 1 10000000:01000000:0.0:1789498927.888313:0:23899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498927.888348:0:23899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.888364:0:23899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.888374:0:23899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498927.888393:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789498927.888441:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.888473:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498927.888676:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698048 00000100:00100000:3.0:1789498927.888692:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698048 00000100:00100000:3.0:1789498927.888728:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498927.888735:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+10:23899:x1876424885698048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.888745:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498927.888759:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19cae expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.888779:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 11 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.888888:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 11 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.888897:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf800, rc 0) 00000100:00100000:3.0:1789498927.888933:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885698048:12345-0@lo:101:mount.lustre.0 Request processed in 199us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498927.888939:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789498927.889127:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498927.889140:0:23899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498927.889149:0:23899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498927.889197:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498927.889218:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.889233:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498927.889291:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698176 00000100:00100000:3.0:1789498927.889302:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698176 00000100:00100000:3.0:1789498927.889326:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498927.889332:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885698176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498927.890066:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885698176:12345-0@lo:501:mount.lustre.0 Request processed in 732us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498927.890075:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789498927.890152:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498927.890184:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498927.890219:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.890286:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1789498927.890316:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698304 00000100:00100000:2.0:1789498927.890320:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698304 00000100:00100000:2.0:1789498927.890372:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498927.890380:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885698304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498927.890575:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885698304:12345-0@lo:503:mount.lustre.0 Request processed in 195us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498927.890582:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498927.890633:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498927.891323:0:23943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23943:1876424885698432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498927.891366:0:23943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.891435:0:23943:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62ef300 going to sleep for 11 seconds 00000100:00100000:3.0:1789498927.891462:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698432 00000100:00100000:3.0:1789498927.891467:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698432 00000100:00100000:3.0:1789498927.891515:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498927.891522:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23943:x1876424885698432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498927.891882:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23943:x1876424885698432:12345-0@lo:502:llog_process_th.0 Request processed in 359us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498927.891890:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789498927.891961:0:23943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23943:1876424885698432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498927.891984:0:23943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498927.891992:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.891994:0:23943:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789498927.892001:0:23943:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e9852f1000 00000020:00000080:1.0:1789498927.892004:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498927.892013:0:23943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498927.892015:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.892020:0:23943:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789498927.892023:0:23943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498927.892026:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.892027:0:23943:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789498927.892030:0:23943:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e9852f1000 00000020:00000080:1.0:1789498927.892032:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498927.892216:0:23943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498927.892220:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.892221:0:23943:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789498927.892224:0:23943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498927.892226:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.892228:0:23943:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789498927.892231:0:23943:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e9852f1000 00000020:00000080:1.0:1789498927.892233:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789498927.897015:0:23943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23943:1876424885698560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498927.897127:0:23943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.897172:0:23943:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498927.897228:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698560 00000100:00100000:1.0:1789498927.897237:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698560 00000100:00100000:1.0:1789498927.897290:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789498927.897302:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23943:x1876424885698560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498927.897551:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23943:x1876424885698560:12345-0@lo:502:llog_process_th.0 Request processed in 250us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498927.897559:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789498927.897612:0:23943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23943:1876424885698560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789498927.897639:0:23943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498927.897646:0:23943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498927.897648:0:23943:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789498927.897654:0:23943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789498927.900661:0:23899:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789498927.900697:0:23899:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498927.900721:0:23899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.900736:0:23899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498927.903044:0:23899:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789498927.903053:0:23899:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e9852f1000 10000000:01000000:3.0:1789498927.903057:0:23899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e9852f1000 10000000:01000000:3.0:1789498927.903063:0:23899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498927.903070:0:23899:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e9852f1000 from 1 10000000:01000000:3.0:1789498927.903073:0:23899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789498927.903130:0:23899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.903142:0:23899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.903155:0:23899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.903179:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498927.903244:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.903299:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498927.903334:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698688 00000100:00100000:3.0:1789498927.903342:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698688 00000100:00100000:3.0:1789498927.903391:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498927.903401:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885698688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.903427:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498927.903441:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc19cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19cbc expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.903465:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc19cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cbc expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.903476:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddea00/0x3a6cb1946bc19cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cbc expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.903485:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddea00, rc 0) 00000100:00100000:3.0:1789498927.903523:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23899:x1876424885698688:12345-0@lo:101:mount.lustre.0 Request processed in 124us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498927.903530:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498927.903588:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498927.903602:0:23899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19cc3 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498927.903612:0:23899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19cc3 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498927.903661:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498927.903698:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.903721:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498927.908149:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698816 00000100:00100000:0.0:1789498927.908169:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698816 00000100:00100000:0.0:1789498927.908228:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789498927.908239:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23899:x1876424885698816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498927.908593:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23899:x1876424885698816:12345-0@lo:501:mount.lustre.0 Request processed in 355us (4893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.908601:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498927.908833:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498927.908887:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498927.908932:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498927.908969:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498927.913362:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885698944 00000100:00100000:0.0:1789498927.913382:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885698944 00000100:00100000:0.0:1789498927.913447:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789498927.913458:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23899:x1876424885698944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498927.913716:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23899:x1876424885698944:12345-0@lo:503:mount.lustre.0 Request processed in 260us (4783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.913724:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789498927.914987:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885698944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498927.915495:0:23948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23948:1876424885699072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498927.915563:0:23948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.915601:0:23948:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498927.915662:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699072 00000100:00100000:2.0:1789498927.915669:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699072 00000100:00100000:2.0:1789498927.915712:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498927.915721:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23948:x1876424885699072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498927.915967:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23948:x1876424885699072:12345-0@lo:502:llog_process_th.0 Request processed in 247us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498927.915977:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789498927.916123:0:23948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23948:1876424885699072:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789498927.916184:0:23948:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789498927.916210:0:23948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98eac1074d40) 00000020:00000080:1.0:1789498927.916231:0:23948:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789498927.916314:0:23948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e9852f1000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789498927.916318:0:23948:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e9852f1000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789498927.916320:0:23948:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e9852f1000 4 00010000:00080000:1.0:1789498927.916351:0:23948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98ea85c66800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1789498927.918070:0:23948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789498927.918281:0:23948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789498927.918313:0:23948:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789498927.918327:0:23948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3a6cb1946bc19cd1 00000100:00080000:1.0:1789498927.918336:0:23948:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498927.918346:0:23948:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98ea85c66800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1789498927.918381:0:23948:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabd542a00 x1876424885699200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498927.918403:0:23948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789498927.922503:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885699200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789498927.922590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498927.922671:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699200 00000100:00100000:0.0:1789498927.922681:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699200 00000100:00100000:0.0:1789498927.922723:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498927.922730:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885699200:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789498927.927261:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885699200:12345-0@lo:38:llog_process_th.0 Request processed in 4521us (4662us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789498927.927275:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498927.927350:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789498927.927359:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea85c66800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498927.927364:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789498927.927368:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885699200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789498927.929073:0:23948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23948:1876424885699328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498927.929173:0:23948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498927.929209:0:23948:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84e76240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498927.931033:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699328 00000100:00100000:0.0:1789498927.931047:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699328 00000100:00100000:0.0:1789498927.931147:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789498927.931158:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23948:x1876424885699328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498927.931458:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23948:x1876424885699328:12345-0@lo:502:llog_process_th.0 Request processed in 302us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498927.931467:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789498927.931532:0:23948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8f836406-9642-48a3-887d-ecfcbfd0595e:23948:1876424885699328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789498927.931568:0:23948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789498927.931979:0:23899:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789498927.932002:0:23899:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789498927.932022:0:23899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19cc3 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498927.932035:0:23899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf000/0x3a6cb1946bc19cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19cc3 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789498927.932083:0:23899:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789498927.932086:0:23899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789498927.932115:0:23899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498927.932117:0:23899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498927.932118:0:23899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498927.932119:0:23899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498927.932126:0:23899:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498927.932127:0:23899:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789498927.932129:0:23899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498927.932130:0:23899:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789498927.932134:0:23899:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789498927.932136:0:23899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498927.932137:0:23899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789498927.932138:0:23899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498927.932139:0:23899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498927.932140:0:23899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498927.932141:0:23899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498927.932142:0:23899:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498927.932143:0:23899:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789498927.932144:0:23899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498927.932145:0:23899:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789498927.932166:0:23899:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789498927.932185:0:23899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885699456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789498927.932235:0:23899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498927.932268:0:23899:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84e76e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498927.934366:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699456 00000100:00100000:0.0:1789498927.934380:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699456 00000100:00100000:0.0:1789498927.934500:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789498927.934513:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23899:x1876424885699456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498927.934543:0:23910:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789498927.934558:0:23910:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789498928.013031:0:23910:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789498928.013051:0:23910:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789498928.013154:0:23933:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789498928.013159:0:23933:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789498928.013187:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498928.013206:0:23933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498928.013215:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498928.013252:0:23933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498928.013266:0:23933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 12 pid: 23912 timeout: 927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498928.013278:0:23933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23933:1876424885699584:0@lo:104: 00000100:00100000:2.0:1789498928.013330:0:23933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498928.013369:0:23933:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789498928.013531:0:23900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699584 00000100:00100000:3.0:1789498928.013539:0:23900:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699584 00000100:00100000:3.0:1789498928.013582:0:23900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498928.013590:0:23900:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+3:23933:x1876424885699584:12345-0@lo:104: 00010000:00010000:3.0:1789498928.013604:0:23900:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.013657:0:23900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789498928.013664:0:23900:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+3:23933:x1876424885699584:12345-0@lo:104: Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498928.013671:0:23900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789498928.013695:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498928.013700:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.013714:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498928.013717:0:23906:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.013726:0:23906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498928.013732:0:23906:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498928.013737:0:23906:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498928.013763:0:23906:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.013770:0:23906:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498928.013789:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.013796:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19ca7 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.013812:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498928.013814:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498928.013816:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498928.013847:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885699712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498928.013875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498928.013947:0:23902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699712 00000100:00100000:3.0:1789498928.013951:0:23902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699712 00010000:00010000:3.0:1789498928.013966:0:23902:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 13 pid: 23912 timeout: 927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498928.013993:0:23902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498928.014000:0:23902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+13:3306:x1876424885699712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498928.014011:0:23902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498928.014016:0:23902:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 13 pid: 23912 timeout: 927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014025:0:23902:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 13 pid: 23912 timeout: 927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014040:0:23902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014047:0:23902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789498928.014061:0:23902:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000903473s 00010000:00010000:3.0:1789498928.014066:0:23902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014072:0:23902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014079:0:23902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014085:0:23902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014110:0:23902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcde00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498928.014119:0:23902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014127:0:23902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014138:0:23902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498928.014144:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadcce00/0x3a6cb1946bc19ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19ca0 expref: 13 pid: 23912 timeout: 927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498928.014149:0:23902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498928.014156:0:23933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23933:1876424885699584:0@lo:104: 00010000:00010000:2.0:1789498928.014175:0:23933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498928.014183:0:23902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3306:x1876424885699712:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1789498928.014187:0:23933:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498928.014196:0:23902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789498928.014198:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498928.014217:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadcde00/0x3a6cb1946bc19cd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498928.014228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885699712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498928.023338:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23899:x1876424885699456:12345-0@lo:253:mount.lustre.0 Request processed in 88820us (91094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498928.023351:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498928.023680:0:23899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:23899:1876424885699456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789498928.023697:0:23899:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789498928.023701:0:23899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498928.023703:0:23899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789498928.023704:0:23899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498928.023706:0:23899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498928.023707:0:23899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498928.023708:0:23899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498928.023709:0:23899:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498928.023711:0:23899:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789498928.023712:0:23899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498928.023714:0:23899:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789498928.023728:0:23899:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789498928.032677:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498928.032867:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498928.033163:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498928.033322:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498928.033601:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498928.033758:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789498928.037957:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789498928.038178:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789498928.038489:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789498928.038718:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789498928.038984:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789498928.039196:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789498928.076013:0:23899:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000020:00080000:1.0:1789498928.076892:0:23955:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:1.0:1789498928.076897:0:23955:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:01000000:2.0:1789498928.076917:0:23899:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789498928.077313:0:23956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789498928.077404:0:23956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789498928.080491:0:23899:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789498928.080621:0:23899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789498928.081010:0:23899:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789498928.081017:0:23899:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789498928.085757:0:23899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498928.087307:0:23956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789498928.087382:0:23956:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789498928.087386:0:23956:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789498928.092249:0:23899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789498928.093048:0:23899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789498928.093201:0:23899:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789498928.096499:0:23899:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1789498928.105803:0:23899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789498928.166125:0:23899:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789498928.166164:0:23899:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba75c0d17988 00100000:10000000:1.0:1789498928.166173:0:23899:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789498928.166890:0:23899:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498928.166910:0:23899:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498928.166924:0:23899:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789498928.166942:0:23899:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789498928.683534:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498929.004803:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789498929.131907:0:23914:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789498929.131916:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e9852f1000 from 9 10000000:01000000:1.0:1789498929.131923:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498929.131972:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498929.131986:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498929.131998:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498929.132025:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885699840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789498929.132195:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498929.133519:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699840 00000100:00100000:3.0:1789498929.133531:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699840 00000100:00100000:3.0:1789498929.133589:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498929.133599:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23914:x1876424885699840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498929.133618:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498929.134031:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19cdf expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498929.134066:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498929.134078:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498929.134107:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde000, rc 0) 00000100:00100000:3.0:1789498929.134174:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885699840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 577us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498929.134182:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498929.135546:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabd513e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789498929.135592:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885699840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498929.135628:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498929.135641:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498929.135723:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885699968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789498929.135775:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498929.135804:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabd513e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789498929.135825:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885699968 00000100:00100000:1.0:1789498929.135834:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885699968 00000100:00100000:1.0:1789498929.135875:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498929.135884:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885699968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789498929.135905:0:23910:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789498929.135923:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789498929.135926:0:23910:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789498929.136010:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885699968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498929.136017:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498929.136055:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885699968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789498929.136111:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789498929.136118:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498929.136128:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498929.708178:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498930.028730:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498930.731610:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498931.756524:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498932.783087:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498933.232187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498933.232195:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498933.232198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498933.232201:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498933.232217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789498933.232220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789498933.232224:0:36:0:(import.c:65:import_set_state_nolock()) ffff98ea85c66800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498933.232239:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98ea85c66800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498933.232264:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea864d0a80 x1876424885700224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498933.232319:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498933.232344:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885700096:0@lo:400:kworker.0 00000100:00100000:2.0:1789498933.232433:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498933.232519:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885700096 00000100:00100000:2.0:1789498933.232526:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885700096 00000100:00100000:2.0:1789498933.232569:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789498933.232577:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3308:x1876424885700096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498933.232627:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3308:x1876424885700096:12345-0@lo:400:kworker.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498933.232634:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789498933.232664:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885700224:0@lo:38:kworker.0 00000100:00100000:2.0:1789498933.232916:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498933.232954:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885700096:0@lo:400:kworker.0 00000100:00100000:1.0:1789498933.233243:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885700224 00000100:00100000:1.0:1789498933.233249:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885700224 00000100:00100000:1.0:1789498933.233273:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498933.233278:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885700224:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789498933.233301:0:23919:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 832 last 0 00000020:00000080:1.0:1789498933.233345:0:23919:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3a6cb1946bc19ced 00000004:00100000:1.0:1789498933.233358:0:23919:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789498933.233477:0:23919:0:(import.c:65:import_set_state_nolock()) ffff98ea910a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498933.233535:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876424885700224:12345-0@lo:38:kworker.0 Request processed in 254us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498933.233541:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789498933.233577:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98ea864d0a80 x1876424885700224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498933.233590:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789498933.233597:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789498933.233602:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789498933.233604:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea85c66800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789498933.233610:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876424885700224:0@lo:38:kworker.0 00000001:02000400:2.0:1789498933.446951:0:24199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789498933.803380:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498934.838186:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498935.852376:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498936.875735:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498937.324162:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498927/real 1789498927] req@ffff98eabb40d500 x1876424885697536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498937 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498937.324192:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eabb40d500 x1876424885697536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498937 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498937.324209:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498927/real 1789498927] req@ffff98ea864d1c00 x1876424885697408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498937 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498937.324222:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98ea864d1c00 x1876424885697408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498937 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498937.324241:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498937.324277:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789498937.324282:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885697536:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789498937.324289:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f89000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498937.324294:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789498937.324296:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885697408:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789498937.325408:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885700352:0@lo:400:kworker.0 00000100:00100000:2.0:1789498937.325485:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789498937.325554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498937.325559:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789498937.325562:0:38:0:(import.c:65:import_set_state_nolock()) ffff98ea83f89000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498937.325567:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 827 00000100:00080000:3.0:1789498937.325572:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789498937.325582:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98ea83f89000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498937.325614:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9fa3b80 x1876424885700480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498937.325628:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498937.325632:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498937.325633:0:38:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498937.325636:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 827 00000100:00080000:3.0:1789498937.325639:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789498937.325643:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea83f8b800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1789498937.325653:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eab9fa0700 x1876424885700608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498937.325725:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885700736:0@lo:400:kworker.0 00000100:00100000:3.0:1789498937.325760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498937.325977:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885700352 00000100:00100000:3.0:1789498937.325985:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885700352 00000100:00100000:3.0:1789498937.326022:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498937.326030:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3308:x1876424885700352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498937.326996:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885700736 00000100:00100000:0.0:1789498937.327002:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885700736 00000100:00100000:0.0:1789498937.327030:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498937.327048:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885700736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498937.327113:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885700736:12345-0@lo:400:kworker.0 Request processed in 76us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498937.327120:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789498937.327318:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98eab9fa0380 x1876424885700736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498937.327331:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885700736:0@lo:400:kworker.0 00000100:00100000:1.0:1789498937.330568:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885700480:0@lo:8:kworker.0 00000400:00000100:1.0:1789498937.330631:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885700480 offset 0 length 520: 4 00000100:00100000:1.0:1789498937.330666:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885700608:0@lo:8:kworker.0 00000400:00000100:1.0:1789498937.330680:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424885700608 offset 0 length 520: 4 00000100:00100000:3.0:1789498937.331187:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3308:x1876424885700352:12345-0@lo:400:kworker.0 Request processed in 5155us (5699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498937.331198:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789498937.332323:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885700352:0@lo:400:kworker.0 00000020:00000080:1.0:1789498937.463756:0:24350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff65181180 20000000:00000080:1.0:1789498937.463776:0:24350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98eac1214800 uarg=0000000000000000 20000000:01000000:1.0:1789498937.463810:0:24350:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789498937.463819:0:24350:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789498937.463824:0:24350:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789498937.464570:0:24351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789498937.464719:0:24350:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789498937.472405:0:24350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789498937.472492:0:24350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498937.472512:0:24350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 11 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498937.472521:0:24350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498937.472580:0:24350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 11 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498937.472657:0:24350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 11 pid: 23911 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498937.472672:0:24350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24350:1876424885700864:0@lo:104: 00000100:00100000:2.0:1789498937.472790:0:24350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498937.472881:0:24350:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84e76900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498937.473780:0:23901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885700864 00000100:00100000:3.0:1789498937.473790:0:23901:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885700864 00000100:00100000:3.0:1789498937.473845:0:23901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498937.473855:0:23901:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8f836406-9642-48a3-887d-ecfcbfd0595e+3:24350:x1876424885700864:12345-0@lo:104: 00010000:00010000:3.0:1789498937.473869:0:23901:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498937.474018:0:24350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24350:1876424885700864:0@lo:104: 00010000:00010000:2.0:1789498937.474038:0:24350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498937.474582:0:23901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789498937.474599:0:23901:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8f836406-9642-48a3-887d-ecfcbfd0595e+3:24350:x1876424885700864:12345-0@lo:104: Request processed in 737us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498937.474606:0:23901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789498937.474819:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498937.474827:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498937.474836:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5c00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:0.0:1789498937.474840:0:23906:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498937.474849:0:23906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498937.474858:0:23906:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498937.474879:0:23906:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789498937.474918:0:23906:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498937.474924:0:23906:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789498937.474974:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885700992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498937.475015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498937.475108:0:23902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885700992 00000100:00100000:1.0:1789498937.475114:0:23902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885700992 00010000:00010000:1.0:1789498937.475138:0:23902:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 12 pid: 23911 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498937.475161:0:23902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498937.475168:0:23902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3306:x1876424885700992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789498937.475179:0:23902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498937.475184:0:23902:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 12 pid: 23911 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475194:0:23902:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 12 pid: 23911 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475208:0:23902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf800/0x3a6cb1946bc19cb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19cae expref: 12 pid: 23911 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475220:0:23902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475228:0:23902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475242:0:23902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475270:0:23902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475276:0:23902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475283:0:23902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475289:0:23902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498937.475293:0:23902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475300:0:23902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475312:0:23902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498937.475321:0:23902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498937.475406:0:24350:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498937.475423:0:24350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498937.475429:0:24350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadcd200/0x3a6cb1946bc19cf4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498937.475848:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498937.475857:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5c00/0x3a6cb1946bc19cae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19cb5 expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498937.475871:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498937.475873:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498937.475876:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498937.483131:0:23902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:3306:x1876424885700992:12345-0@lo:103:ldlm_bl.0 Request processed in 7952us (8104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498937.483147:0:23902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498937.485322:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885700992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498937.899617:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498938.927258:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789498939.307655:0:23914:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498939.307664:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e9852f1000 from 10 10000000:01000000:3.0:1789498939.307670:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498939.307730:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498939.307743:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498939.307764:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498939.307802:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885701120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498939.307873:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498939.307927:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789498939.307981:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701120 00000100:00100000:0.0:1789498939.307991:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701120 00000100:00100000:0.0:1789498939.308048:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789498939.308058:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+11:23914:x1876424885701120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498939.308071:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498939.308085:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19cfb expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498939.308188:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 12 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498939.308201:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 12 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498939.308235:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5e00, rc 0) 00000100:00100000:0.0:1789498939.308302:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885701120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498939.308317:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498939.308813:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885701120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498939.308827:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498939.308837:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498939.308893:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885701248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498939.308920:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498939.308950:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789498939.309061:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701248 00000100:00100000:0.0:1789498939.309066:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701248 00000100:00100000:0.0:1789498939.309152:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789498939.309161:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885701248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498939.309530:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885701248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498939.309537:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498939.309747:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885701248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498939.309791:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885701376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498939.309832:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498939.309864:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498939.310038:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701376 00000100:00100000:2.0:1789498939.310043:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701376 00000100:00100000:2.0:1789498939.310079:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498939.310110:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885701376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498939.310292:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:23914:x1876424885701376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498939.310306:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498939.310554:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885701376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789498939.328445:0:24408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789498939.328661:0:23914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789498939.328687:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498939.328700:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498939.328723:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498939.947892:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789498940.273983:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498940.972754:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498941.995671:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498942.447488:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498942.447495:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498942.447498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498942.447501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498942.447534:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885701632:0@lo:400:kworker.0 00000100:00100000:0.0:1789498942.447600:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498942.448454:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498942.448466:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885701504:0@lo:400:kworker.0 00000100:00100000:0.0:1789498942.448515:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498942.448565:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701504 00000100:00100000:0.0:1789498942.448573:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701504 00000100:00100000:0.0:1789498942.448621:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789498942.448638:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3308:x1876424885701504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498942.448803:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701632 00000100:00100000:1.0:1789498942.448808:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701632 00000100:00100000:1.0:1789498942.448839:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498942.448846:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885701632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498942.448902:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885701632:12345-0@lo:400:kworker.0 Request processed in 56us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498942.448909:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789498942.448952:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98eabb40c700 x1876424885701632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498942.448967:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885701632:0@lo:400:kworker.0 00000100:00100000:0.0:1789498942.449342:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+12:3308:x1876424885701504:12345-0@lo:400:kworker.0 Request processed in 705us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498942.449350:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498942.450872:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885701504:0@lo:400:kworker.0 00010000:00010000:3.0:1789498943.037225:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789498943.111907:0:24598:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789498943.111921:0:24598:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789498943.112046:0:24598:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98ea89100000 00000020:01000004:3.0:1789498943.112061:0:24598:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789498943.112073:0:24598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789498943.112124:0:24598:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98ea83f299c0) 00000020:00000080:3.0:1789498943.112142:0:24598:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789498943.149720:0:24598:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789498943.151370:0:24598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789498943.153525:0:24598:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789498943.160226:0:24598:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789498943.173071:0:24598:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1789498943.173782:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 539: rc = 0 00100000:10000000:0.0:1789498943.174012:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:0.0:1789498943.174218:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 539: rc = 0 00100000:10000000:0.0:1789498943.174828:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 568: rc = 0 00100000:10000000:0.0:1789498943.178654:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 568: rc = 0 00100000:10000000:0.0:1789498943.178945:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 568: rc = 0 00100000:10000000:0.0:1789498943.179240:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 568: rc = 0 00100000:10000000:0.0:1789498943.179485:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 568: rc = 0 00100000:10000000:0.0:1789498943.179748:0:24598:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 568: rc = 0 00000020:00000080:0.0:1789498943.181653:0:24598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789498943.181667:0:24598:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789498943.181681:0:24598:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3a6cb1946bc19d10 00000020:01000004:0.0:1789498943.181691:0:24598:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789498943.181713:0:24598:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789498943.181717:0:24598:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789498943.181724:0:24598:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789498943.181730:0:24598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789498943.181744:0:24598:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98e984438000) 00000020:00000080:0.0:1789498943.181755:0:24598:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1789498943.186653:0:24598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498943.187521:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789498943.187534:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789498943.190766:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789498943.190782:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789498943.206307:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789498943.206326:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789498943.215723:0:24598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498943.215936:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789498943.215942:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789498943.225785:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789498943.225797:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789498943.266754:0:24598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498943.268594:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789498943.268603:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789498943.280682:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789498943.280698:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789498943.281801:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789498943.281812:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789498943.320436:0:24598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498943.320665:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789498943.320673:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789498943.326833:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789498943.326849:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789498943.468598:0:24598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498943.468849:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789498943.468856:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789498943.471446:0:24598:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789498943.471460:0:24598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789498943.485616:0:24598:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789498943.485658:0:24598:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789498943.485666:0:24598:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789498943.496891:0:24598:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789498943.496945:0:24598:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789498943.496950:0:24598:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789498943.496952:0:24598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498943.496953:0:24598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498943.496955:0:24598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498943.496956:0:24598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498943.496957:0:24598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498943.496959:0:24598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498943.496960:0:24598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498943.496962:0:24598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498943.496965:0:24598:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789498943.496968:0:24598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498943.496969:0:24598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498943.496970:0:24598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498943.496971:0:24598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498943.496972:0:24598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498943.496973:0:24598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498943.496975:0:24598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498943.496976:0:24598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498943.496977:0:24598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498943.497003:0:24598:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789498943.497023:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885701760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498943.497118:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498943.497194:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498943.497353:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701760 00000100:00100000:2.0:1789498943.497362:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701760 00000100:00100000:2.0:1789498943.497422:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498943.497433:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:24598:x1876424885701760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789498943.497477:0:23911:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789498943.497481:0:23911:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789498943.497495:0:23911:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789498943.504787:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:24598:x1876424885701760:12345-0@lo:253:mount.lustre.0 Request processed in 7347us (7658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498943.504802:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789498943.504892:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885701760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789498943.504995:0:24598:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789498943.505000:0:24598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789498943.505001:0:24598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498943.505003:0:24598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498943.505004:0:24598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498943.505006:0:24598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498943.505007:0:24598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498943.505009:0:24598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498943.505010:0:24598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498943.505012:0:24598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789498943.505032:0:24598:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98ea89100000 from lustre-OST0000 10000000:01000000:0.0:1789498943.505056:0:24598:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789498943.505060:0:24598:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789498943.505067:0:24598:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e985268000 local copy 00010000:00010000:0.0:1789498943.505078:0:24598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498943.505576:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885701888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.505622:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.506243:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498943.506326:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885701888 00000100:00100000:3.0:1789498943.506334:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885701888 00000100:00100000:3.0:1789498943.506420:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498943.506430:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:24598:x1876424885701888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.506733:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885701888:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789498943.506756:0:24598:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789498943.506900:0:24598:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789498943.506908:0:24598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.506996:0:24598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498943.507022:0:24598:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98ea89100000 10000000:01000000:2.0:1789498943.507027:0:24598:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789498943.507031:0:24598:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98e985268000 10000000:01000000:2.0:1789498943.507034:0:24598:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789498943.507037:0:24598:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98e985268000 from 1 10000000:01000000:2.0:1789498943.507040:0:24598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789498943.507079:0:24598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.507117:0:24598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.507128:0:24598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498943.507173:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789498943.507209:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498943.507259:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+12:24598:x1876424885701888:12345-0@lo:501:mount.lustre.0 Request processed in 829us (1634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498943.507267:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789498943.507640:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498943.507789:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702016 00000100:00100000:3.0:1789498943.507794:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702016 00000100:00100000:1.0:1789498943.507884:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498943.507895:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+12:24598:x1876424885702016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498943.507905:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498943.507931:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e00200/0x3a6cb1946bc19d25 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19d1e expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.507968:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e00200/0x3a6cb1946bc19d25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d1e expref: 13 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.507979:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e00200/0x3a6cb1946bc19d25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d1e expref: 13 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.507989:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00200, rc 0) 00000100:00100000:1.0:1789498943.508039:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+13:24598:x1876424885702016:12345-0@lo:101:mount.lustre.0 Request processed in 146us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498943.508045:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789498943.508208:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498943.508223:0:24598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d25 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.508231:0:24598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19d25 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498943.508260:0:24598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789498943.508278:0:24598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d25 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.508286:0:24598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadcc000/0x3a6cb1946bc19d1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d25 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498943.508293:0:24598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789498943.508297:0:24598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498943.508303:0:24598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789498943.508306:0:24598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789498943.508324:0:24598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.508331:0:24598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.508339:0:24598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498943.508356:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789498943.508385:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.508414:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.508471:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702144 00000100:00100000:0.0:1789498943.508476:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702144 00000100:00100000:0.0:1789498943.508512:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789498943.508520:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+13:24598:x1876424885702144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498943.508527:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498943.508535:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa4200/0x3a6cb1946bc19d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19d2c expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.508549:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa4200/0x3a6cb1946bc19d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d2c expref: 14 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.508558:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa4200/0x3a6cb1946bc19d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d2c expref: 14 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.508564:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4200, rc 0) 00000100:00100000:0.0:1789498943.508601:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702144:12345-0@lo:101:mount.lustre.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.508607:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498943.508747:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498943.508757:0:24598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d33 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.508765:0:24598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19d33 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498943.509527:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1789498943.510394:0:24598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498943.510621:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789498943.510666:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789498943.510699:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789498943.510746:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789498943.510784:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789498943.510818:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789498943.510886:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789498943.510923:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789498943.510958:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1789498943.511007:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1789498943.511044:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1789498943.511133:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1789498943.511211:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1789498943.511219:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789498943.511294:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.511351:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.511384:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f3540 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.511848:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702272 00000100:00100000:0.0:1789498943.511855:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702272 00000100:00100000:0.0:1789498943.511907:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789498943.511916:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498943.512309:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702272:12345-0@lo:501:mount.lustre.0 Request processed in 394us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.512317:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498943.512773:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.512816:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498943.512860:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.512996:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea889f3540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498943.513028:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702400 00000100:00100000:3.0:1789498943.513033:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702400 00000100:00100000:3.0:1789498943.513128:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789498943.513146:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498943.513466:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702400:12345-0@lo:503:mount.lustre.0 Request processed in 330us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498943.513473:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498943.513562:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498943.514512:0:24598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498943.514584:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498943.514866:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.515255:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85122b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.515342:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702528 00000100:00100000:0.0:1789498943.515350:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702528 00000100:00100000:1.0:1789498943.515513:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789498943.515523:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498943.516256:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702528:12345-0@lo:502:mount.lustre.0 Request processed in 732us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498943.516264:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789498943.516372:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498943.516779:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789498943.516843:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789498943.516877:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789498943.516955:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789498943.517021:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789498943.517056:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789498943.517164:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789498943.517210:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789498943.517250:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789498943.517298:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789498943.517337:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789498943.517385:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789498943.517431:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498943.517488:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.517836:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85122b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498943.518002:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702656 00000100:00100000:3.0:1789498943.518010:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702656 00000100:00100000:3.0:1789498943.518053:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789498943.518064:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498943.518335:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702656:12345-0@lo:502:mount.lustre.0 Request processed in 272us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498943.518342:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498943.518578:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498943.518675:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789498943.518688:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789498943.520046:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789498943.520056:0:24612:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789498943.520063:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.520066:0:24612:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789498943.520070:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498943.520112:0:24612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98eabadc3380) 00000020:00000080:2.0:1789498943.520150:0:24612:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789498943.520157:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789498943.520238:0:24612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98ea89100000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789498943.520245:0:24612:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789498943.520256:0:24612:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3a6cb1946bc19d41 00010000:00010000:3.0:1789498943.534480:0:24612:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789498943.535438:0:24612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1789498943.538218:0:24612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789498943.548239:0:24612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789498943.548262:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498943.548272:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498943.548274:0:24612:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789498943.548279:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789498943.548282:0:24612:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789498943.548284:0:24612:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789498943.548285:0:24612:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789498943.548287:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789498943.548290:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498943.548291:0:24612:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789498943.548294:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498943.548297:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498943.548298:0:24612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789498943.548302:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789498943.548304:0:24612:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789498943.548307:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498943.548310:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498943.548311:0:24612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789498943.548313:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498943.548316:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498943.548317:0:24612:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789498943.548335:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789498943.548434:0:24612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498943.548439:0:24612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498943.548440:0:24612:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789498943.548444:0:24612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789498943.549398:0:24598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789498943.549433:0:24598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789498943.549464:0:24598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d33 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.549478:0:24598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadcca00/0x3a6cb1946bc19d2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d33 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498943.549486:0:24598:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea89100000 from 1 10000000:01000000:0.0:1789498943.549489:0:24598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498943.549529:0:24598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.549538:0:24598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.549551:0:24598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498943.549586:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789498943.551017:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498943.551076:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498943.551263:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702784 00000100:00100000:1.0:1789498943.551272:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702784 00000100:00100000:1.0:1789498943.551329:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498943.551338:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+14:24598:x1876424885702784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498943.551353:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498943.551369:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19d48 expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.551394:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 15 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.551405:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 15 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.551423:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00000, rc 0) 00000100:00100000:1.0:1789498943.551478:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885702784:12345-0@lo:101:mount.lustre.0 Request processed in 141us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498943.551485:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789498943.551577:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498943.551594:0:24598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498943.551603:0:24598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498943.556424:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1789498943.561295:0:24598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498943.561584:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789498943.567064:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789498943.567532:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789498943.567572:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789498943.567602:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789498943.569289:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789498943.569370:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789498943.569401:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789498943.569487:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789498943.569496:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1789498943.569607:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.571278:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.571366:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85122a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.583235:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885702912 00000100:00100000:0.0:1789498943.583252:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885702912 00000100:00100000:0.0:1789498943.583322:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789498943.583332:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885702912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498943.583852:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885702912:12345-0@lo:501:mount.lustre.0 Request processed in 500us (12558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.583861:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498943.584014:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885702912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.584062:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498943.584410:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.584435:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85122a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.584506:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703040 00000100:00100000:0.0:1789498943.584512:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703040 00000100:00100000:0.0:1789498943.584546:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789498943.584554:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498943.584729:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703040:12345-0@lo:503:mount.lustre.0 Request processed in 175us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.584736:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789498943.584856:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498943.585373:0:24598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498943.585438:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498943.585483:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.585506:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85122a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498943.585743:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703168 00000100:00100000:1.0:1789498943.585750:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703168 00000100:00100000:1.0:1789498943.585792:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789498943.585800:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498943.585957:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703168:12345-0@lo:502:mount.lustre.0 Request processed in 157us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498943.585964:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498943.586048:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498943.586325:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789498943.586374:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789498943.586419:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789498943.586453:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789498943.586501:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789498943.586546:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789498943.586578:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789498943.586608:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1789498943.586886:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498943.586932:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498943.586963:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea85168600 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.587049:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703296 00000100:00100000:0.0:1789498943.587054:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703296 00000100:00100000:0.0:1789498943.587114:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789498943.587122:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498943.587281:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703296:12345-0@lo:502:mount.lustre.0 Request processed in 160us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.587288:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789498943.587396:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498943.587490:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1789498943.587501:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789498943.588577:0:24616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498943.588588:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.588591:0:24616:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789498943.588597:0:24616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea89100000 00000020:00000080:2.0:1789498943.588600:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498943.588607:0:24616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498943.588609:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.588611:0:24616:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789498943.588613:0:24616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498943.588615:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.588616:0:24616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789498943.588620:0:24616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea89100000 00000020:00000080:2.0:1789498943.588621:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498943.588689:0:24616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498943.588692:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.588693:0:24616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789498943.588695:0:24616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498943.588698:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.588699:0:24616:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789498943.588702:0:24616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98ea89100000 00000020:00000080:2.0:1789498943.588704:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498943.588734:0:24616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498943.588737:0:24616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498943.588738:0:24616:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789498943.588741:0:24616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1789498943.588915:0:24598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789498943.588939:0:24598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498943.588958:0:24598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.588971:0:24598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498943.589017:0:24598:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789498943.589020:0:24598:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98ea89100000 10000000:01000000:3.0:1789498943.589022:0:24598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98ea89100000 10000000:01000000:3.0:1789498943.589026:0:24598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498943.589031:0:24598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea89100000 from 1 10000000:01000000:3.0:1789498943.589034:0:24598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789498943.589065:0:24598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.589112:0:24598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.589134:0:24598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498943.589169:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498943.589221:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498943.589249:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498943.599353:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703424 00000100:00100000:0.0:1789498943.599374:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703424 00000100:00100000:0.0:1789498943.599433:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789498943.599443:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885703424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498943.599464:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498943.599484:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5c00/0x3a6cb1946bc19d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19d56 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.599513:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5c00/0x3a6cb1946bc19d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d56 expref: 16 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.599525:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa5c00/0x3a6cb1946bc19d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d56 expref: 16 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498943.599534:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5c00, rc 0) 00000100:00100000:0.0:1789498943.599612:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703424:12345-0@lo:101:mount.lustre.0 Request processed in 171us (10391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.599618:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789498943.599862:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498943.599880:0:24598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d5d expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.599891:0:24598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19d5d expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498943.614938:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1789498943.615476:0:24598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498943.615729:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789498943.615771:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789498943.615802:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789498943.615857:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789498943.615891:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789498943.615933:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789498943.615965:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789498943.615994:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789498943.616037:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789498943.616070:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789498943.616126:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789498943.616194:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789498943.616239:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789498943.616270:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789498943.616312:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789498943.616345:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789498943.616374:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789498943.616415:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789498943.616446:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789498943.616498:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789498943.616545:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789498943.616577:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789498943.616606:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789498943.616647:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789498943.616678:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1789498943.616708:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1789498943.616749:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1789498943.616782:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1789498943.616811:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1789498943.616853:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1789498943.616886:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1789498943.616916:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1789498943.616945:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1789498943.616988:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1789498943.617020:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1789498943.617121:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1789498943.617175:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1789498943.617207:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1789498943.617261:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1789498943.617304:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1789498943.617393:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1789498943.617400:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1789498943.617497:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498943.617557:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498943.617612:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87385600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498943.618429:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703552 00000100:00100000:2.0:1789498943.618438:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703552 00000100:00100000:2.0:1789498943.618491:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498943.618500:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498943.618813:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703552:12345-0@lo:501:mount.lustre.0 Request processed in 313us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498943.618820:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789498943.621294:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498943.621350:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498943.621416:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498943.621452:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703680 00000100:00100000:3.0:1789498943.621458:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703680 00000100:00100000:3.0:1789498943.621504:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789498943.621513:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498943.621691:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703680:12345-0@lo:503:mount.lustre.0 Request processed in 178us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498943.621698:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789498943.621738:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6ba3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498943.621749:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789498943.622344:0:24598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789498943.622420:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498943.622459:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498943.622485:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703808 00000100:00100000:3.0:1789498943.622490:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703808 00000100:00100000:3.0:1789498943.622509:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789498943.622516:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498943.622679:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703808:12345-0@lo:502:mount.lustre.0 Request processed in 162us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498943.622686:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789498943.622721:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498943.622737:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498943.622941:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789498943.622985:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789498943.623016:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789498943.623056:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789498943.623115:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789498943.623180:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789498943.623214:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789498943.623258:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789498943.623302:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789498943.623334:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789498943.629171:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789498943.629264:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789498943.629334:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789498943.629377:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789498943.629434:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789498943.629473:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789498943.629518:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789498943.629563:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789498943.629595:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789498943.629630:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789498943.629683:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789498943.629725:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789498943.629765:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789498943.629843:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789498943.629886:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1789498943.629929:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1789498943.629985:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1789498943.630025:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1789498943.630062:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1789498943.630155:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1789498943.630193:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1789498943.630223:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1789498943.630252:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1789498943.630293:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1789498943.630325:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1789498943.630365:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1789498943.630397:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1789498943.632299:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1789498943.632380:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1789498943.632440:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1789498943.632493:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498943.632574:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498943.638611:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eabada2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498943.644759:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885703936 00000100:00100000:2.0:1789498943.644773:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885703936 00000100:00100000:2.0:1789498943.644837:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498943.644846:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498943.645175:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885703936:12345-0@lo:502:mount.lustre.0 Request processed in 329us (12601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498943.645183:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498943.645255:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885703936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498943.645368:0:24598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1789498943.645386:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789498943.647884:0:24621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789498943.647902:0:24621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98eabadc19c0) 00000020:00000080:2.0:1789498943.647924:0:24621:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789498943.647994:0:24621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98ea89100000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789498943.647998:0:24621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98ea89100000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789498943.648000:0:24621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea89100000 3 00010000:00080000:2.0:1789498943.648036:0:24621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98eaba057000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1789498943.650672:0:24621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789498943.650931:0:24621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789498943.650974:0:24621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789498943.650987:0:24621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3a6cb1946bc19d6b 00000100:00080000:2.0:1789498943.651001:0:24621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498943.651018:0:24621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98eaba057000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498943.651063:0:24621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea864d2a00 x1876424885704064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498943.651118:0:24621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789498943.651262:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885704064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498943.651338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498943.651452:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704064 00000100:00100000:2.0:1789498943.651460:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704064 00000100:00100000:2.0:1789498943.655235:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498943.655249:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876424885704064:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789498943.655283:0:23919:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:2.0:1789498943.655327:0:23919:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3a6cb1946bc19d72 00000004:00100000:2.0:1789498943.655343:0:23919:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789498943.655377:0:23919:0:(import.c:65:import_set_state_nolock()) ffff98e9847f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498943.655465:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876424885704064:12345-0@lo:38:llog_process_th.0 Request processed in 216us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498943.655473:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789498943.655570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498943.655575:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498943.655578:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498943.655581:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498943.655642:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885704192:0@lo:400:kworker.0 00000100:00100000:0.0:1789498943.655681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789498943.676445:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98ea864d2a00 x1876424885704064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498943.676460:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498943.676469:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789498943.676477:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789498943.676483:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789498943.676486:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eaba057000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789498943.676508:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876424885704064:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789498943.676764:0:24621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1789498943.689192:0:24598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789498943.689252:0:24598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789498943.689276:0:24598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d5d expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.689290:0:24598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde400/0x3a6cb1946bc19d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d5d expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789498943.689356:0:24598:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789498943.689358:0:24598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789498943.689359:0:24598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498943.689360:0:24598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498943.689362:0:24598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498943.689363:0:24598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498943.689364:0:24598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498943.689367:0:24598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498943.689368:0:24598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789498943.689371:0:24598:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789498943.689374:0:24598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498943.689375:0:24598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789498943.689376:0:24598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498943.689378:0:24598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498943.689378:0:24598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498943.689379:0:24598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498943.689380:0:24598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498943.689381:0:24598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498943.689382:0:24598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789498943.689512:0:24598:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789498943.689535:0:24598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885704320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789498943.689611:0:24598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498943.689653:0:24598:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498943.691181:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704320 00000100:00100000:1.0:1789498943.691211:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704320 00000100:00100000:1.0:1789498943.691273:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789498943.691282:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:24598:x1876424885704320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789498943.691312:0:23910:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789498943.691327:0:23910:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789498943.702572:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704192 00000100:00100000:3.0:1789498943.702589:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704192 00000100:00100000:1.0:1789498943.705018:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498943.705030:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498943.705153:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885704192:12345-0@lo:400:kworker.0 Request processed in 123us (49470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498943.705161:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789498943.717887:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98eabb40dc00 x1876424885704192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498943.717910:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885704192:0@lo:400:kworker.0 20000000:01000000:0.0:1789498943.722708:0:23910:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789498943.722731:0:23910:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789498943.723454:0:23933:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789498943.723461:0:23933:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789498943.723486:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.723505:0:23933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 16 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.723514:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.723556:0:23933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 16 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.723571:0:23933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 16 pid: 23912 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498943.723604:0:23933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23933:1876424885704448:0@lo:104: 00000100:00100000:1.0:1789498943.723671:0:23933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498943.723713:0:23933:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea885266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498943.723737:0:23900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704448 00000100:00100000:1.0:1789498943.723744:0:23900:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704448 00000100:00100000:1.0:1789498943.723785:0:23900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498943.723793:0:23900:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+3:23933:x1876424885704448:12345-0@lo:104: 00010000:00010000:1.0:1789498943.723806:0:23900:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.723853:0:23900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498943.723859:0:23900:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+3:23933:x1876424885704448:12345-0@lo:104: Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498943.723866:0:23900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498943.723902:0:23933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23933:1876424885704448:0@lo:104: 00010000:00010000:1.0:1789498943.725649:0:23933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.725676:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498943.725682:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.725690:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:1.0:1789498943.725695:0:23905:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.725704:0:23905:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498943.725725:0:23905:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498943.725731:0:23905:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789498943.725780:0:23905:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.725787:0:23905:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498943.725807:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.725815:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eac1e01800/0x3a6cb1946bc19cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19ce6 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498943.725830:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498943.725832:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498943.725834:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498943.725851:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885704576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498943.725911:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498943.727521:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704576 00000100:00100000:3.0:1789498943.727535:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704576 00010000:00010000:3.0:1789498943.727571:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 17 pid: 23912 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498943.727600:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498943.727609:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+17:3306:x1876424885704576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498943.727634:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498943.727640:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 17 pid: 23912 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727653:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 17 pid: 23912 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727671:0:23904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabadde000/0x3a6cb1946bc19ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19cdf expref: 17 pid: 23912 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727685:0:23904:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727695:0:23904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789498943.727710:0:23904:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004249882s 00010000:00010000:3.0:1789498943.727715:0:23904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727723:0:23904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727732:0:23904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727760:0:23904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727767:0:23904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498943.727772:0:23904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727780:0:23904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727797:0:23904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727809:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498943.727861:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3306:x1876424885704576:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498943.727868:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789498943.727887:0:23933:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727894:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498943.727898:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e01600/0x3a6cb1946bc19d79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498943.728866:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885704576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498943.733945:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+15:24598:x1876424885704320:12345-0@lo:253:mount.lustre.0 Request processed in 42655us (44324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498943.733960:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789498943.734201:0:24598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:24598:1876424885704320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789498943.734282:0:24598:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789498943.734286:0:24598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498943.734288:0:24598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789498943.734290:0:24598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498943.734291:0:24598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498943.734292:0:24598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498943.734293:0:24598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498943.734295:0:24598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498943.734297:0:24598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498943.734299:0:24598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789498943.734330:0:24598:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789498943.734845:0:24598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789498943.735057:0:24598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789498943.741392:0:24598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789498943.741698:0:24598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789498943.741884:0:24598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789498943.742405:0:24598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789498943.743483:0:24598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789498943.778544:0:24598:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789498943.778552:0:24598:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789498943.778687:0:24598:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789498943.778751:0:24598:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789498943.778768:0:24598:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789498943.778800:0:24598:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789498944.043441:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498945.072270:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789498945.579318:0:23914:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789498945.579329:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e9852f1000 from 10 10000000:01000000:2.0:1789498945.579335:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789498945.579425:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498945.579439:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498945.579453:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498945.579489:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885704704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498945.579594:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498945.579675:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab0dfe000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498945.580543:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704704 00000100:00100000:0.0:1789498945.580571:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704704 00000100:00100000:0.0:1789498945.580637:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789498945.580647:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+15:23914:x1876424885704704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498945.580665:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498945.580685:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19d80 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498945.580717:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 16 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498945.580741:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 16 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498945.580751:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4c00, rc 0) 00000100:00100000:0.0:1789498945.580816:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:23914:x1876424885704704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498945.580823:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789498945.580885:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885704704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498945.580907:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498945.580917:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498945.581193:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885704832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789498945.581239:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498945.581269:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87385240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498945.581285:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704832 00000100:00100000:0.0:1789498945.581289:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704832 00000100:00100000:0.0:1789498945.581313:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789498945.581320:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:23914:x1876424885704832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789498945.581337:0:23910:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789498945.581356:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789498945.581360:0:23910:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789498945.581446:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:23914:x1876424885704832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498945.581463:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789498945.581499:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885704832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789498945.581578:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789498945.581587:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498945.581596:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498946.093199:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498947.115552:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498948.140040:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789498949.100312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498949.100320:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498949.100323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498949.100326:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789498949.100402:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885705088:0@lo:400:kworker.0 00000100:00100000:1.0:1789498949.100474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498949.100547:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498949.100554:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885704960:0@lo:400:kworker.0 00000100:00100000:1.0:1789498949.100582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498949.100841:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498949.100851:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885705216:0@lo:400:kworker.0 00000100:00100000:3.0:1789498949.100880:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498949.100912:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705088 00000100:00100000:3.0:1789498949.100921:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705088 00000100:00100000:3.0:1789498949.100969:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705216 00000100:00100000:3.0:1789498949.100974:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705216 00000100:00100000:0.0:1789498949.101416:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885704960 00000100:00100000:0.0:1789498949.101422:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885704960 00000100:00100000:0.0:1789498949.101453:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789498949.101461:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3308:x1876424885704960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498949.105180:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498949.105199:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885705088:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789498949.105746:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498949.105764:0:23917:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789498949.105774:0:23917:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789498949.105905:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498949.105915:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885705216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498949.105970:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424885705216:12345-0@lo:400:kworker.0 Request processed in 57us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498949.105978:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498949.107365:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3308:x1876424885704960:12345-0@lo:400:kworker.0 Request processed in 5899us (6775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498949.107377:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789498949.108016:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabd542d80 x1876424885705216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498949.108034:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424885705216:0@lo:400:kworker.0 00000100:00100000:3.0:1789498949.109726:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885705088:12345-0@lo:400:kworker.0 Request processed in 4528us (9245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498949.109740:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498949.110646:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8f836406-9642-48a3-887d-ecfcbfd0595e:3308:1876424885704960:0@lo:400:kworker.0 00010000:00080000:1.0:1789498949.110686:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabd540700 x1876424885705088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498949.110698:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885705088:0@lo:400:kworker.0 00010000:00010000:3.0:1789498949.164604:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498950.187777:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789498950.407467:0:24969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789498950.515401:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498951.213249:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498952.236426:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498952.881989:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498937/real 1789498937] req@ffff98eab9fa3b80 x1876424885700480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498952 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498952.882023:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eab9fa3b80 x1876424885700480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498952 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498952.882033:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498937/real 1789498937] req@ffff98eab9fa0700 x1876424885700608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498952 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498952.882045:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98eab9fa0700 x1876424885700608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498952 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789498952.882074:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f89000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498952.882117:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789498952.882120:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885700480:0@lo:8:kworker.0 00000100:00080000:0.0:1789498952.882126:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498952.882130:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789498952.882133:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885700608:0@lo:8:kworker.0 00000100:00080000:0.0:1789498952.882204:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498952.882208:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789498952.882211:0:37:0:(import.c:65:import_set_state_nolock()) ffff98ea83f89000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498952.882216:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 837 00000100:00080000:0.0:1789498952.882221:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789498952.882231:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98ea83f89000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498952.882250:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb40fb80 x1876424885705472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789498952.882263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498952.882267:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789498952.882268:0:37:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498952.882271:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 837 00000100:00080000:0.0:1789498952.882274:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789498952.882278:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea83f8b800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498952.882289:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb40c700 x1876424885705600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498952.882332:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498952.882350:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885705344:0@lo:400:kworker.0 00000100:00100000:0.0:1789498952.882413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498952.882483:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705344 00000100:00100000:0.0:1789498952.882492:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705344 00000100:00100000:0.0:1789498952.882540:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789498952.882550:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3305:x1876424885705344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498952.883624:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3305:x1876424885705344:12345-0@lo:400:kworker.0 Request processed in 1006us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498952.883636:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789498952.883685:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885705472:0@lo:8:kworker.0 00000100:00100000:0.0:1789498952.883723:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498952.883756:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885705600:0@lo:8:kworker.0 00000100:00100000:0.0:1789498952.883782:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498952.883818:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705472 00000100:00100000:0.0:1789498952.884164:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705472 00000100:00100000:0.0:1789498952.884190:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705600 00000100:00100000:0.0:1789498952.884194:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705600 00000100:00100000:0.0:1789498952.884206:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498952.884211:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876424885705472:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789498952.884236:0:24601:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 852 last 0 00000020:00000080:0.0:1789498952.884267:0:24601:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19d8e 00002000:00100000:0.0:1789498952.884282:0:24601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98eababde800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789498952.884287:0:24601:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789498952.884290:0:24601:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789498952.886566:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885705344:0@lo:400:kworker.0 00002000:00080000:0.0:1789498952.886855:0:24601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789498952.886886:0:24601:0:(import.c:65:import_set_state_nolock()) ffff98eababde000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498952.886998:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876424885705472:12345-0@lo:8:kworker.0 Request processed in 2784us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498952.887007:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498952.887032:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498952.887038:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876424885705600:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789498952.887054:0:24601:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789498952.889176:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb40fb80 x1876424885705472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498952.889192:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498952.889201:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789498952.889210:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789498952.889217:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789498952.889220:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f89000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789498952.889241:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789498952.889248:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885705472:0@lo:8:kworker.0 00000100:00100000:3.0:1789498952.890423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885705728:0@lo:400:kworker.0 00000100:00100000:3.0:1789498952.890510:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498952.890555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498952.890571:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885705856:0@lo:400:kworker.0 00000100:00100000:3.0:1789498952.890597:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498952.890635:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705728 00000100:00100000:3.0:1789498952.890643:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705728 00000100:00100000:3.0:1789498952.890687:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705856 00000100:00100000:3.0:1789498952.890691:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705856 00000100:00100000:3.0:1789498952.890721:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498952.890730:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885705728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498952.890797:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885705728:12345-0@lo:400:kworker.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498952.890804:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498952.890837:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498952.890844:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885705856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498952.890872:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885705856:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498952.890878:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789498952.890898:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789498952.890927:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb40d500 x1876424885705856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498952.890940:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885705856:0@lo:400:kworker.0 00010000:00080000:3.0:1789498952.890951:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb40e680 x1876424885705728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498952.890959:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885705728:0@lo:400:kworker.0 00000004:00080000:1.0:1789498952.894526:0:23940:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:1.0:1789498952.894565:0:23940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23940:1876424885706112:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789498952.894630:0:23940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498952.894658:0:23940:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e983fdd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498952.894942:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498952.894957:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885705984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498952.895003:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498952.895048:0:24602:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789498952.895055:0:24602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789498952.895182:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706112 00000100:00100000:2.0:1789498952.895190:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706112 00000100:00100000:2.0:1789498952.895305:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498952.895315:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23940:x1876424885706112:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789498952.898627:0:24603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885705984 00000100:00100000:1.0:1789498952.898639:0:24603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885705984 00000100:00100000:1.0:1789498952.898696:0:24603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498952.898706:0:24603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876424885705984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498952.898743:0:24603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498952.898836:0:24603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876424885705984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (3832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498952.898844:0:24603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789498952.898898:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabd540700 x1876424885705984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498952.898919:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885705984:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789498952.901323:0:23939:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789498952.901778:0:23939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852665686757ns, next at 0ns, rc = 0 00000100:00080000:3.0:1789498952.903750:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789498952.908243:0:25097:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789498952.908263:0:25097:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789498952.908269:0:25097:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:0.0:1789498952.916513:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876424885705600:12345-0@lo:8:kworker.0 Request processed in 29465us (32722us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789498952.916528:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789498952.920627:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498952.920638:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789498952.920643:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885705600:0@lo:8:kworker.0 00002000:00010000:2.0:1789498952.959398:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.959411:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.959427:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.959431:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.959437:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.959454:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.959465:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.959473:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.959497:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498952.959622:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498952.959630:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.959638:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498952.959642:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.959652:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.959670:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.959678:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000926877e3/0x3a6cb1946bc19d95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.959695:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498952.959703:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498952.959705:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.963478:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.963492:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.963509:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.963513:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.963519:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.963540:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.963552:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.963896:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.963931:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498952.964484:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.964491:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.964503:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.964507:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.964511:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.964521:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.964530:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.964548:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.964748:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498952.964755:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.964763:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadccc00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498952.964767:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.964777:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.964805:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.964814:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbab4ad2/0x3a6cb1946bc19d9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498952.964829:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498952.964831:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498952.964833:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498952.967440:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498952.967676:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498952.967692:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.967706:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498952.967710:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.967721:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.967743:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.967751:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0658f4/0x3a6cb1946bc19da3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.967771:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.967773:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.967774:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.976034:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.976048:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.976067:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.976072:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.976078:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.976115:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.976127:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.976134:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.976162:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498952.976665:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498952.976675:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.976685:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498952.976690:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.976714:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.976733:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.976740:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083436f6b/0x3a6cb1946bc19daa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.976761:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.976763:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.976765:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.978190:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.978201:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.978222:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.978226:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.978232:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.978244:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.978253:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.978261:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.978282:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498952.979020:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498952.979028:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.979039:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498952.979044:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.979053:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.979070:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.979103:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c76673ad/0x3a6cb1946bc19db1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.979123:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.979124:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.979126:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.980104:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.980115:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980128:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.980133:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.980139:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980150:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980170:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980178:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980193:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498952.980202:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498952.980206:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980214:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498952.980217:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980225:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980238:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980245:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62191f3/0x3a6cb1946bc19db8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.980258:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498952.980266:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498952.980267:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.984552:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.984574:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.984591:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.984595:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.984601:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.984615:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.984625:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.984633:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.984658:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498952.984896:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498952.984904:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.984912:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498952.984917:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.984925:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.984942:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.984949:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa7ef54/0x3a6cb1946bc19dbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.984966:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.984982:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.984983:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.985346:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.985352:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.985361:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.985364:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.985368:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.985383:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.985391:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.985398:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.985422:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498952.985962:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498952.985977:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.985986:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcda00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498952.985990:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.985998:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.986011:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.986019:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f441119/0x3a6cb1946bc19dc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.986034:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.986036:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.986038:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.987027:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.987037:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.987050:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.987054:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.987060:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.987071:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.987079:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.987120:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.987132:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498952.987139:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498952.987144:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.987151:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcde00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498952.987154:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.987173:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.987186:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.987193:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb17119/0x3a6cb1946bc19dcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498952.987218:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.987220:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498952.987222:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498952.989673:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.989685:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.989703:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.989707:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.989712:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.989726:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.989735:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.989743:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.989805:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498952.990392:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498952.990399:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.990415:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498952.990418:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498952.990422:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.990432:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.990440:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498952.990447:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498952.999997:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498953.000014:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000029:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.000033:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000044:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000077:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000085:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe5590d/0x3a6cb1946bc19dd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000124:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.000127:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000134:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcd000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.000137:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000143:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000152:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.000159:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.000161:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.000163:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.001483:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789498953.001494:0:25097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f4fdfd2/0x3a6cb1946bc19ddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498953.002007:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.002524:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.002532:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.002547:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.002551:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.002791:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.002817:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.002885:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.002894:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.002940:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498953.003383:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.003389:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.003398:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.003401:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.003405:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.003414:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.003423:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.003442:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789498953.004394:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789498953.007613:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498953.007627:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007649:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcc400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.007654:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007665:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007685:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007691:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032dcf3d7/0x3a6cb1946bc19de2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007711:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.007715:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007721:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.007724:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007731:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007740:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.007752:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.007754:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.007755:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.008672:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789498953.008682:0:25097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c7aa434/0x3a6cb1946bc19de9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789498953.009375:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.009383:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.009396:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.009400:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.009406:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.009418:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.009428:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.009435:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.009468:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498953.009533:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498953.009550:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498953.009558:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498953.009563:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498953.009571:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498953.009585:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498953.009600:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052aabd48/0x3a6cb1946bc19df0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498953.009615:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498953.009617:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498953.009618:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.010872:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.011265:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.011274:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.011289:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.011293:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.011298:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.011310:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.011320:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.011328:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.011347:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.011729:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.011736:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.011744:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.011748:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.011756:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.011772:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.011778:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb81210/0x3a6cb1946bc19df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.011793:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.011795:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.011797:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.014013:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.014026:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.014042:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.014053:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.014059:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.014077:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.014109:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.014118:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.014139:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498953.014803:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.014809:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.014937:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.014945:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.014960:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.014965:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.014984:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.015002:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.015010:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19dfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.015028:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.015030:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.015032:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.018766:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.018779:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.018790:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.018812:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.018834:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.018859:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.018882:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498953.019575:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.019582:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019594:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.019598:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.019602:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019612:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019622:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019629:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019647:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498953.019657:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498953.019663:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019676:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498953.019680:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019689:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019706:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019714:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019732:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498953.019735:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019741:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498953.019744:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019750:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019759:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019771:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.019784:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.019786:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.019788:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.020886:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.020894:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.020907:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.020911:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.020916:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.020936:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.020946:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.020953:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.020982:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498953.020991:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498953.021002:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021010:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498953.021013:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021022:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021037:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021045:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021059:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.021061:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.021062:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.021650:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.021657:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021668:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.021671:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.021675:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021741:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021750:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021759:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021803:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498953.021811:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498953.021815:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021822:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498953.021825:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021833:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021845:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021853:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19e1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.021872:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.021873:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.021875:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.023703:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.031032:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.031044:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031061:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.031066:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.031072:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031086:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031132:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031140:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031163:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.031458:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.031466:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.031487:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.031492:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.031514:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.031532:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.031540:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d46f7256/0x3a6cb1946bc19e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.031564:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.031565:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.031567:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498953.031933:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.031939:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031958:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.031961:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.031978:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031988:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.031996:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.032002:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.032020:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498953.032439:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498953.032445:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.032454:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=852s v=(0 0) 00010000:00010000:2.0:1789498953.032458:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498953.032462:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.032471:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.032621:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.032627:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.032634:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.032638:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.032646:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.032659:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.032676:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19e28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.032690:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.032692:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.032694:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498953.033007:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.033014:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498953.033037:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.033262:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.033267:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033275:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.033279:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033287:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033298:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033305:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ab649f/0x3a6cb1946bc19e2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033318:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.033320:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.033321:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.033575:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.033582:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.033591:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.033600:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.033605:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.033615:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.033623:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.033630:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.033651:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.033669:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.033674:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033682:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.033685:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033693:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033716:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033724:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000147245f1/0x3a6cb1946bc19e36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.033736:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.033738:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.033739:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.034071:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.034077:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034085:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.034110:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.034115:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034126:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034134:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034147:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034168:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.034211:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.034216:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034225:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.034228:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034246:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034258:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034265:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19e3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034278:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.034280:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.034282:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.034549:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.034555:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034564:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.034567:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.034571:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034580:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034587:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034595:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.034619:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.034633:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.034637:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034645:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.034648:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034656:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034668:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034685:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.034698:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.034699:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.034701:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.035030:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.035036:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035050:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.035053:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.035057:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035066:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035075:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035082:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035118:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.035154:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.035159:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035166:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.035171:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035180:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035191:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035198:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e191c642/0x3a6cb1946bc19e4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035211:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.035212:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.035214:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.035505:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.035511:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035519:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.035522:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.035526:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035536:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035555:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035563:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.035583:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.035633:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.035639:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035646:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.035650:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035657:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035668:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035676:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4134b8/0x3a6cb1946bc19e52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.035690:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.035691:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.035693:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.035998:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.036004:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036012:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.036016:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.036021:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036030:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036038:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036046:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036078:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.036128:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.036134:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036142:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.036145:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036164:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036175:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036182:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be0778ae/0x3a6cb1946bc19e59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036195:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.036196:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.036198:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.036487:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.036493:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036502:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.036505:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.036509:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036518:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036526:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036534:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036553:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498953.036634:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.036639:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036647:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.036651:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036659:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036670:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036688:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ad20e90/0x3a6cb1946bc19e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.036702:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.036704:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.036706:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498953.036943:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498953.036950:0:25097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.036957:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=852s v=(0 0) 00010000:00010000:0.0:1789498953.041173:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498953.041194:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.041217:0:25097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.041231:0:25097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.041240:0:25097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498953.046201:0:25097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789498953.046614:0:25097:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:0.0:1789498953.046725:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23940:x1876424885706112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 151407us (152090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498953.046735:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498953.046779:0:23940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23940:1876424885706112:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789498953.046806:0:23940:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1789498953.046870:0:23940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23940:1876424885706240:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789498953.046910:0:23940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498953.046963:0:23940:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88526f00 going to sleep for 11 seconds 00010000:00010000:3.0:1789498953.048564:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498953.048581:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.048596:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498953.048602:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.048614:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.048636:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.048643:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000527414b/0x3a6cb1946bc19e67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498953.048666:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.048668:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498953.048670:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498953.048760:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706240 00000100:00100000:0.0:1789498953.048768:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706240 00000100:00100000:0.0:1789498953.048824:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498953.048833:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23940:x1876424885706240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789498953.048880:0:24602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:1.0:1789498953.060668:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:23940:x1876424885706240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11827us (13748us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789498953.060687:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498953.064171:0:23940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23940:1876424885706240:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789498953.064192:0:23940:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:3.0:1789498953.260631:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498954.284895:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789498954.383043:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1789498954.383075:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789498955.307466:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498956.334380:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498957.355966:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498958.315297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498958.315303:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789498958.315306:0:36:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498958.315314:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 852 00000100:00080000:0.0:1789498958.315328:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789498958.315340:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea83f8b800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498958.315365:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb40d180 x1876424885706624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498958.315422:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885706880:0@lo:400:kworker.0 00000100:00100000:0.0:1789498958.315519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.315582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498958.315589:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885706368:0@lo:400:kworker.0 00000100:00100000:0.0:1789498958.315620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.315654:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885706624:0@lo:8:kworker.0 00000100:00100000:0.0:1789498958.315680:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.315713:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706880 00000100:00100000:0.0:1789498958.315720:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706880 00000100:00100000:0.0:1789498958.315773:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498958.315782:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885706880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498958.315835:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885706880:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.315852:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498958.315884:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706368 00000100:00100000:0.0:1789498958.315888:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706368 00000100:00100000:0.0:1789498958.316279:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789498958.316286:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3305:x1876424885706368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498958.316318:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3305:x1876424885706368:12345-0@lo:400:kworker.0 Request processed in 33us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.316325:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789498958.316352:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706624 00000100:00100000:0.0:1789498958.316364:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706624 00000100:00100000:0.0:1789498958.316387:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498958.316391:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876424885706624:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789498958.316407:0:24601:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498958.316560:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885706496:0@lo:400:kworker.0 00000100:00100000:3.0:1789498958.316591:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.316614:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498958.316620:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885706752:0@lo:400:kworker.0 00000100:00100000:3.0:1789498958.316642:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789498958.316668:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498958.316688:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706496 00000100:00100000:3.0:1789498958.316692:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706496 00000100:00100000:3.0:1789498958.316724:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498958.316730:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885706496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498958.316764:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885706496:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.316770:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498958.316786:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885706752 00000100:00100000:3.0:1789498958.316789:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885706752 00000100:00100000:3.0:1789498958.316812:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498958.316818:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885706752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498958.316846:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885706752:12345-0@lo:400:kworker.0 Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.316852:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789498958.316882:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789498958.316915:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb40ce00 x1876424885706752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498958.316936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885706752:0@lo:400:kworker.0 00000100:00100000:3.0:1789498958.316950:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789498958.316963:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885706496:0@lo:400:kworker.0 00000100:00100000:1.0:1789498958.323821:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885706368:0@lo:400:kworker.0 00010000:00080000:1.0:1789498958.323855:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98eabb40d880 x1876424885706880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498958.323868:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885706880:0@lo:400:kworker.0 00000100:00100000:1.0:1789498958.326759:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498958.326774:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885707008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498958.326844:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498958.327998:0:24603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707008 00000100:00100000:1.0:1789498958.328009:0:24603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707008 00000100:00100000:1.0:1789498958.328064:0:24603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498958.328073:0:24603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885707008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498958.329203:0:24603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498958.329284:0:24603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885707008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1210us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498958.329293:0:24603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498958.331802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885707008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498958.352660:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876424885706624:12345-0@lo:8:kworker.0 Request processed in 36256us (36967us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789498958.352675:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789498958.352751:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498958.352757:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789498958.352761:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885706624:0@lo:8:kworker.0 00010000:00010000:2.0:1789498958.380575:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789498958.485169:0:25322:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789498958.485174:0:25322:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789498958.485326:0:25322:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98ea89568000 00000020:01000004:3.0:1789498958.485347:0:25322:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789498958.485432:0:25322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789498958.485457:0:25322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98ea83f2cd40) 00000020:00000080:3.0:1789498958.485475:0:25322:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789498958.547399:0:25322:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789498958.547815:0:25322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789498958.549233:0:25322:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789498958.550626:0:25322:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789498958.551686:0:25322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1789498958.555479:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 593: rc = 0 00100000:10000000:3.0:1789498958.555598:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 593: rc = 0 00100000:10000000:3.0:1789498958.555703:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 593: rc = 0 00100000:10000000:3.0:1789498958.559586:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 675: rc = 0 00100000:10000000:2.0:1789498958.561285:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 675: rc = 0 00100000:10000000:2.0:1789498958.561730:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 675: rc = 0 00100000:10000000:2.0:1789498958.562312:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 675: rc = 0 00100000:10000000:2.0:1789498958.562812:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 675: rc = 0 00100000:10000000:2.0:1789498958.569304:0:25322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 675: rc = 0 00000020:00000080:2.0:1789498958.570954:0:25322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789498958.570969:0:25322:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789498958.570991:0:25322:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3a6cb1946bc19e75 00000020:01000004:2.0:1789498958.571000:0:25322:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789498958.571024:0:25322:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789498958.571028:0:25322:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789498958.571034:0:25322:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789498958.571059:0:25322:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789498958.571064:0:25322:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789498958.615256:0:25322:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789498958.615294:0:25322:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789498958.615298:0:25322:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789498958.615299:0:25322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498958.615301:0:25322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498958.615302:0:25322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498958.615303:0:25322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498958.615305:0:25322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498958.615306:0:25322:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498958.615308:0:25322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498958.615309:0:25322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498958.615313:0:25322:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789498958.615315:0:25322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498958.615317:0:25322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498958.615318:0:25322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498958.615319:0:25322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498958.615320:0:25322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498958.615321:0:25322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498958.615322:0:25322:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498958.615323:0:25322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498958.615324:0:25322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498958.615348:0:25322:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789498958.615382:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789498958.615461:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.615607:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707136 00000100:00100000:0.0:1789498958.615615:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707136 00000100:00100000:0.0:1789498958.615668:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789498958.615676:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:25322:x1876424885707136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498958.615722:0:23910:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789498958.615725:0:23910:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789498958.615729:0:23910:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789498958.616665:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.628405:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:25322:x1876424885707136:12345-0@lo:253:mount.lustre.0 Request processed in 12719us (12933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.628421:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498958.628674:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707136:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789498958.628690:0:25322:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789498958.628694:0:25322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498958.628696:0:25322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498958.628698:0:25322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498958.628699:0:25322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498958.628700:0:25322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498958.628701:0:25322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498958.628703:0:25322:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498958.628718:0:25322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498958.628720:0:25322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789498958.628742:0:25322:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98ea89568000 from lustre-OST0001 10000000:01000000:1.0:1789498958.628770:0:25322:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789498958.628773:0:25322:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789498958.628780:0:25322:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e985268000 local copy 00010000:00010000:1.0:1789498958.628791:0:25322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498958.629778:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498958.629825:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498958.629880:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.630716:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707264 00000100:00100000:0.0:1789498958.630727:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707264 00000100:00100000:0.0:1789498958.630834:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789498958.630853:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:25322:x1876424885707264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498958.636281:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:25322:x1876424885707264:12345-0@lo:501:mount.lustre.0 Request processed in 5420us (6445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498958.636298:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789498958.643022:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707264:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789498958.643056:0:25322:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789498958.644248:0:25322:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789498958.644263:0:25322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498958.644276:0:25322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddfa00/0x3a6cb1946bc19c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19c0d expref: -99 pid: 23899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498958.644305:0:25322:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98ea89568000 10000000:01000000:1.0:1789498958.644309:0:25322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789498958.644314:0:25322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789498958.644317:0:25322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498958.644321:0:25322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789498958.644323:0:25322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789498958.644494:0:25322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498958.644570:0:25322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498958.644582:0:25322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498958.644604:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498958.644666:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498958.644772:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.653000:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707392 00000100:00100000:0.0:1789498958.653019:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707392 00000100:00100000:0.0:1789498958.654319:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498958.654339:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+16:25322:x1876424885707392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498958.654368:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498958.654390:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc19e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19e7c expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.654420:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc19e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19e7c expref: 17 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.654430:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa5200/0x3a6cb1946bc19e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19e7c expref: 17 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.654452:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5200, rc 0) 00000100:00100000:0.0:1789498958.654673:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707392:12345-0@lo:101:mount.lustre.0 Request processed in 342us (10005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.654680:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498958.656243:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498958.656271:0:25322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19e83 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.656285:0:25322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19e83 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498958.657376:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789498958.661314:0:25322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498958.667990:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789498958.668051:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789498958.672290:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789498958.672459:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789498958.672513:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789498958.672554:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789498958.672605:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789498958.672646:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789498958.672707:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789498958.672839:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789498958.672849:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789498958.672967:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498958.673034:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.673082:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.673484:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707520 00000100:00100000:0.0:1789498958.673492:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707520 00000100:00100000:0.0:1789498958.673554:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789498958.673564:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498958.673932:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707520:12345-0@lo:501:mount.lustre.0 Request processed in 368us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.673940:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498958.674233:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498958.674274:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498958.674314:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.674341:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.674920:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707648 00000100:00100000:0.0:1789498958.674926:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707648 00000100:00100000:0.0:1789498958.674968:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789498958.674975:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498958.682733:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707648:12345-0@lo:503:mount.lustre.0 Request processed in 7749us (8409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498958.682746:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789498958.685653:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498958.701898:0:25322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498958.702000:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498958.702074:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498958.702137:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.702304:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707776 00000100:00100000:3.0:1789498958.702313:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707776 00000100:00100000:3.0:1789498958.702361:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789498958.702371:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498958.702601:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707776:12345-0@lo:502:mount.lustre.0 Request processed in 231us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.702617:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498958.702978:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498958.703284:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789498958.703341:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789498958.703383:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789498958.704814:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789498958.704911:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789498958.704954:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789498958.705014:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789498958.705079:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789498958.705626:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789498958.705671:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498958.705736:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498958.705779:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaba6a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.706123:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885707904 00000100:00100000:0.0:1789498958.706131:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885707904 00000100:00100000:0.0:1789498958.706176:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789498958.706185:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498958.706385:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885707904:12345-0@lo:502:mount.lustre.0 Request processed in 200us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.706394:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498958.706729:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885707904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498958.706807:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789498958.706818:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789498958.709598:0:25324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789498958.709610:0:25324:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789498958.709617:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.709619:0:25324:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789498958.709626:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789498958.709641:0:25324:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98e98443b380) 00000020:00000080:0.0:1789498958.709664:0:25324:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789498958.709670:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789498958.709746:0:25324:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98ea89568000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789498958.709754:0:25324:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789498958.709761:0:25324:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3a6cb1946bc19e91 00010000:00010000:1.0:1789498958.729985:0:25324:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789498958.731729:0:25324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:2.0:1789498958.735800:0:25324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1789498958.746830:0:25324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789498958.746849:0:25324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498958.746855:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498958.746857:0:25324:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789498958.746860:0:25324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498958.746874:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498958.746876:0:25324:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789498958.746880:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789498958.746882:0:25324:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789498958.746885:0:25324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498958.746887:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498958.746888:0:25324:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789498958.746891:0:25324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498958.746893:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498958.746894:0:25324:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498958.746897:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789498958.746960:0:25324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498958.746962:0:25324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498958.746964:0:25324:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498958.746967:0:25324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789498958.748210:0:25322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789498958.748247:0:25322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789498958.748284:0:25322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19e83 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.748298:0:25322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eac1e00c00/0x3a6cb1946bc19e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19e83 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498958.748307:0:25322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea89568000 from 1 10000000:01000000:3.0:1789498958.748310:0:25322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498958.748351:0:25322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.748368:0:25322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.748380:0:25322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498958.748404:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498958.748486:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.748714:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708032 00000100:00100000:0.0:1789498958.748723:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708032 00000100:00100000:0.0:1789498958.748772:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789498958.748781:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+17:25322:x1876424885708032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498958.748796:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498958.748811:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19e98 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.748837:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 18 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.748879:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 18 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.748889:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4e00, rc 0) 00000100:00100000:3.0:1789498958.750526:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.758674:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708032:12345-0@lo:101:mount.lustre.0 Request processed in 9879us (10172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.758688:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498958.758918:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498958.758944:0:25322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498958.758956:0:25322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498958.759802:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1789498958.764748:0:25322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498958.765206:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789498958.765263:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789498958.765313:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789498958.765610:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789498958.765662:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789498958.765717:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789498958.765780:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789498958.765820:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789498958.765921:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789498958.765930:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1789498958.766028:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498958.766122:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.766169:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.766448:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708160 00000100:00100000:3.0:1789498958.766457:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708160 00000100:00100000:3.0:1789498958.766520:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498958.766530:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498958.766759:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708160:12345-0@lo:501:mount.lustre.0 Request processed in 230us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.766775:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789498958.769076:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498958.770341:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498958.770432:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.770477:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498958.772338:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708288 00000100:00100000:1.0:1789498958.772354:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708288 00000100:00100000:1.0:1789498958.772411:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498958.772422:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498958.772695:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708288:12345-0@lo:503:mount.lustre.0 Request processed in 274us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498958.772713:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498958.773001:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789498958.773793:0:25322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789498958.780282:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498958.780393:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.780446:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.780674:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708416 00000100:00100000:3.0:1789498958.780694:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708416 00000100:00100000:3.0:1789498958.780750:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789498958.780760:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498958.781032:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708416:12345-0@lo:502:mount.lustre.0 Request processed in 273us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.781041:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789498958.781855:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498958.782673:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789498958.782797:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789498958.782952:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789498958.782998:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789498958.783034:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789498958.783289:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789498958.783339:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789498958.783614:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1789498958.783667:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498958.783753:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498958.783788:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.783939:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708544 00000100:00100000:3.0:1789498958.783948:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708544 00000100:00100000:3.0:1789498958.784000:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789498958.784009:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabad8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498958.784245:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabad8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708544:12345-0@lo:502:mount.lustre.0 Request processed in 237us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.784254:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789498958.785255:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498958.785413:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789498958.785428:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789498958.789797:0:25328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498958.789813:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.789815:0:25328:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789498958.789824:0:25328:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea89568000 00000020:00000080:0.0:1789498958.789826:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498958.789848:0:25328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498958.789852:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.789854:0:25328:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789498958.789857:0:25328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498958.789877:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.789879:0:25328:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789498958.789884:0:25328:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98ea89568000 00000020:00000080:0.0:1789498958.789887:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498958.789958:0:25328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498958.789962:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.789964:0:25328:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789498958.789966:0:25328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498958.789970:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.789971:0:25328:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789498958.789975:0:25328:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98ea89568000 00000020:00000080:0.0:1789498958.789977:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498958.790022:0:25328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498958.790025:0:25328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498958.790027:0:25328:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789498958.790030:0:25328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1789498958.797334:0:25322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789498958.797378:0:25322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498958.797406:0:25322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.797419:0:25322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498958.797484:0:25322:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789498958.797487:0:25322:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98ea89568000 10000000:01000000:3.0:1789498958.797491:0:25322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98ea89568000 10000000:01000000:3.0:1789498958.797495:0:25322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498958.797520:0:25322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98ea89568000 from 1 10000000:01000000:3.0:1789498958.797523:0:25322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789498958.797558:0:25322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.797566:0:25322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.797577:0:25322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498958.797600:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498958.797674:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.797728:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea850efd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.797757:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708672 00000100:00100000:3.0:1789498958.797765:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708672 00000100:00100000:3.0:1789498958.797813:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498958.797824:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885708672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498958.797853:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498958.797875:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf600/0x3a6cb1946bc19ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19ea6 expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.797900:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf600/0x3a6cb1946bc19ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ea6 expref: 19 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.797911:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf600/0x3a6cb1946bc19ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ea6 expref: 19 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.797919:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf600, rc 0) 00000100:00100000:3.0:1789498958.797958:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885708672:12345-0@lo:101:mount.lustre.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.797972:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789498958.798022:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498958.798036:0:25322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ead expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.798045:0:25322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19ead expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498958.799270:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1789498958.799573:0:25322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498958.801897:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789498958.801989:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789498958.802027:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789498958.802073:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789498958.803799:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789498958.803952:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789498958.803995:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789498958.804035:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789498958.805596:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789498958.818549:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789498958.818632:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789498958.818736:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789498958.818777:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789498958.818815:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789498958.818882:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789498958.818929:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789498958.818968:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789498958.819023:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789498958.819065:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789498958.819126:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789498958.819192:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789498958.819233:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789498958.819271:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789498958.819324:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789498958.819379:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1789498958.819419:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1789498958.819472:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1789498958.819529:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1789498958.819566:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1789498958.819629:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1789498958.819670:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1789498958.819706:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1789498958.819743:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1789498958.819790:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1789498958.819829:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1789498958.819898:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1789498958.819939:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1789498958.819979:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1789498958.820031:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1789498958.820067:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1789498958.820193:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1789498958.820202:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1789498958.820304:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498958.820370:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.820426:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708800 00000100:00100000:3.0:1789498958.820433:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708800 00000100:00100000:3.0:1789498958.820478:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789498958.820487:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885708800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498958.820706:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885708800:12345-0@lo:501:mount.lustre.0 Request processed in 219us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.820723:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789498958.820769:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.820786:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498958.820816:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498958.820852:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.820891:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885708928 00000100:00100000:3.0:1789498958.820895:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885708928 00000100:00100000:3.0:1789498958.820918:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789498958.820924:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885708928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498958.821061:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885708928:12345-0@lo:503:mount.lustre.0 Request processed in 135us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.821068:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789498958.821147:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.821160:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885708928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789498958.821619:0:25322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789498958.821689:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885709056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498958.821726:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.821755:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709056 00000100:00100000:3.0:1789498958.821759:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709056 00000100:00100000:3.0:1789498958.821783:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789498958.821790:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885709056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498958.827651:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.835177:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885709056:12345-0@lo:502:mount.lustre.0 Request processed in 13377us (13440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.835191:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789498958.835259:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885709056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498958.835561:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789498958.835616:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789498958.835653:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789498958.835707:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789498958.835747:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789498958.835835:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789498958.835893:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789498958.835933:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789498958.835988:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789498958.836028:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789498958.836061:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789498958.836132:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789498958.836172:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789498958.836211:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789498958.836265:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789498958.836318:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789498958.836355:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789498958.836402:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789498958.836439:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789498958.836481:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789498958.836535:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789498958.836576:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789498958.836612:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789498958.836663:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789498958.836703:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1789498958.836739:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1789498958.836786:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1789498958.836822:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1789498958.836854:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1789498958.836920:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1789498958.836960:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1789498958.837022:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1789498958.837063:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1789498958.837139:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1789498958.837180:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1789498958.837234:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1789498958.837280:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1789498958.837318:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1789498958.837371:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1789498958.837411:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1789498958.837457:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885709184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498958.837526:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.837568:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498958.837597:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709184 00000100:00100000:3.0:1789498958.837604:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709184 00000100:00100000:3.0:1789498958.837646:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789498958.837655:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885709184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498958.844977:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885709184:12345-0@lo:502:mount.lustre.0 Request processed in 209us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.844993:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789498958.845108:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885709184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498958.845256:0:25322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1789498958.845272:0:25322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789498958.854152:0:25334:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789498958.854170:0:25334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98eabadc4d40) 00000020:00000080:2.0:1789498958.854194:0:25334:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789498958.854282:0:25334:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98ea89568000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789498958.854287:0:25334:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98ea89568000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789498958.854289:0:25334:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98ea89568000 3 00010000:00080000:2.0:1789498958.854319:0:25334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98eac0a92000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1789498958.857791:0:25334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789498958.858023:0:25334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789498958.858062:0:25334:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789498958.858078:0:25334:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3a6cb1946bc19ebb 00000100:00080000:2.0:1789498958.858125:0:25334:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498958.858138:0:25334:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98eac0a92000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1789498958.858176:0:25334:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98ea864d1500 x1876424885709312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498958.858207:0:25334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789498958.860225:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885709312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789498958.860302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498958.864309:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709312 00000100:00100000:1.0:1789498958.864324:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709312 00000100:00100000:1.0:1789498958.864372:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498958.864379:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876424885709312:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789498958.864410:0:23917:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 858 last 0 00000040:00080000:3.0:1789498958.864609:0:25334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1789498958.864754:0:25322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789498958.864786:0:25322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789498958.864804:0:25322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ead expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.864816:0:25322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf800/0x3a6cb1946bc19ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ead expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789498958.864895:0:25322:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789498958.864897:0:25322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498958.864899:0:25322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498958.864900:0:25322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498958.864902:0:25322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498958.864903:0:25322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498958.864905:0:25322:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498958.864908:0:25322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498958.864909:0:25322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789498958.864913:0:25322:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789498958.864915:0:25322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789498958.864917:0:25322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498958.864918:0:25322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498958.864919:0:25322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498958.864920:0:25322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498958.864921:0:25322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498958.864922:0:25322:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498958.864923:0:25322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498958.864924:0:25322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789498958.864946:0:25322:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789498958.864963:0:25322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885709440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789498958.865038:0:25322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.865081:0:25322:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87f5c840 going to sleep for 11 seconds 00000020:00000080:1.0:1789498958.865199:0:23917:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3a6cb1946bc19ec2 00000004:00100000:1.0:1789498958.865215:0:23917:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789498958.865249:0:23917:0:(import.c:65:import_set_state_nolock()) ffff98e98441b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498958.865314:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876424885709312:12345-0@lo:38:llog_process_th.0 Request processed in 933us (5010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498958.865322:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789498958.865380:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98ea864d1500 x1876424885709312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498958.865392:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498958.865400:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789498958.865407:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789498958.865412:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789498958.865415:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98eac0a92000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789498958.865420:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876424885709312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789498958.866269:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709440 00000100:00100000:0.0:1789498958.866277:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709440 00000100:00100000:0.0:1789498958.866379:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498958.866389:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:25322:x1876424885709440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498958.866417:0:23911:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789498958.866446:0:23911:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789498958.935236:0:23911:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789498958.935283:0:23911:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789498958.935587:0:23933:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789498958.935593:0:23933:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789498958.935616:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.935637:0:23933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 19 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.935646:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.935704:0:23933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 19 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.935720:0:23933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 19 pid: 23911 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498958.935734:0:23933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23933:1876424885709568:0@lo:104: 00000100:00100000:3.0:1789498958.935799:0:23933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.935888:0:23933:0:(client.c:2716:ptlrpc_set_wait()) set ffff98e985b09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498958.940163:0:23901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709568 00000100:00100000:0.0:1789498958.940177:0:23901:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709568 00000100:00100000:0.0:1789498958.940224:0:23901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498958.940233:0:23901:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8f836406-9642-48a3-887d-ecfcbfd0595e+3:23933:x1876424885709568:12345-0@lo:104: 00010000:00010000:0.0:1789498958.940253:0:23901:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498958.940358:0:23901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789498958.940378:0:23901:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8f836406-9642-48a3-887d-ecfcbfd0595e+3:23933:x1876424885709568:12345-0@lo:104: Request processed in 146us (4578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498958.940385:0:23901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789498958.940619:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498958.940627:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940636:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadcdc00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:3.0:1789498958.940640:0:23906:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940650:0:23906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498958.940657:0:23906:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498958.940663:0:23906:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498958.940708:0:23906:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940716:0:23906:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498958.940739:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940753:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadcdc00/0x3a6cb1946bc19d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d87 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940769:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498958.940771:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498958.940772:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498958.940787:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885709696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498958.940825:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498958.940893:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709696 00000100:00100000:3.0:1789498958.940897:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709696 00010000:00010000:3.0:1789498958.940917:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 20 pid: 23911 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498958.940936:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498958.940943:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+20:3307:x1876424885709696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498958.940953:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498958.940958:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 20 pid: 23911 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940968:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 20 pid: 23911 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940986:0:23904:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.940994:0:23904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789498958.941012:0:23904:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005419617s 00010000:00010000:3.0:1789498958.941024:0:23904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941032:0:23904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941039:0:23904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941046:0:23904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941051:0:23904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddf200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498958.941055:0:23904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941063:0:23904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941072:0:23904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941127:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498958.941156:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+20:3307:x1876424885709696:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498958.941163:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498958.941195:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885709696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498958.941220:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa4c00/0x3a6cb1946bc19d87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19d80 expref: 19 pid: 23911 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498958.941230:0:23933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23933:1876424885709568:0@lo:104: 00010000:00010000:3.0:1789498958.941247:0:23933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941256:0:23933:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941262:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498958.941269:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19ec9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498958.948078:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+18:25322:x1876424885709440:12345-0@lo:253:mount.lustre.0 Request processed in 81683us (83031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498958.948119:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789498958.948347:0:25322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8f836406-9642-48a3-887d-ecfcbfd0595e:25322:1876424885709440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498958.948420:0:25322:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789498958.948423:0:25322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498958.948425:0:25322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498958.948426:0:25322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498958.948428:0:25322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498958.948481:0:25322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498958.948483:0:25322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498958.948485:0:25322:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498958.948487:0:25322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498958.948488:0:25322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789498958.948565:0:25322:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789498958.949268:0:25322:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789498958.949649:0:25322:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789498958.949808:0:25322:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498958.952875:0:25322:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789498958.953234:0:25322:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789498958.953678:0:25322:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789498958.955970:0:25322:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789498959.131926:0:25322:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789498959.131938:0:25322:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789498959.131980:0:25322:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498959.132065:0:25322:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498959.132114:0:25322:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789498959.132147:0:25322:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789498959.403797:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498960.430872:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498960.749734:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789498960.811155:0:23914:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789498960.811163:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e9852f1000 from 11 10000000:01000000:0.0:1789498960.811168:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789498960.811215:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498960.811228:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498960.811240:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498960.811266:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885709824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498960.811342:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498960.811396:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498960.811508:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709824 00000100:00100000:2.0:1789498960.811516:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709824 00000100:00100000:2.0:1789498960.811572:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498960.811581:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885709824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498960.811595:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498960.811609:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc19ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc19ed0 expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498960.811631:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc19ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ed0 expref: 19 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498960.811642:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eab6554800/0x3a6cb1946bc19ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19ed0 expref: 19 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498960.811658:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eab6554800, rc 0) 00000100:00100000:2.0:1789498960.811712:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885709824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498960.811718:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498960.811766:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885709824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498960.811780:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ed7 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498960.811788:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc19ed7 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498960.811850:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885709952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789498960.811880:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498960.811895:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82b6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789498960.811909:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885709952 00000100:00100000:2.0:1789498960.811912:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885709952 00000100:00100000:2.0:1789498960.811934:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789498960.811940:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885709952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789498960.811953:0:23911:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789498960.811972:0:23911:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789498960.811976:0:23911:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789498960.812050:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885709952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498960.812058:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789498960.812110:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885709952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789498960.812171:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789498960.812178:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ed7 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498960.812187:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa4800/0x3a6cb1946bc19ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc19ed7 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498961.455553:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498962.477718:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498963.435617:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885710080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498963.435697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498963.435969:0:24603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710080 00000100:00100000:1.0:1789498963.435994:0:24603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710080 00000100:00100000:1.0:1789498963.436083:0:24603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498963.436112:0:24603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885710080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498963.436152:0:24603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498963.436208:0:24603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885710080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498963.436216:0:24603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498963.436556:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885710080:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789498963.436574:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789498963.501058:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498963.951434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498963.951442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789498963.951446:0:37:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498963.951454:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 858 00000100:00080000:0.0:1789498963.951459:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789498963.951471:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98ea83f8b800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1789498963.951494:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98eabb40d880 x1876424885710336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498963.951571:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885710592:0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.951647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498963.951724:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498963.951732:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885710720:0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.951762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498963.951816:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885710336:0@lo:8:kworker.0 00000100:00100000:0.0:1789498963.951842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498963.951874:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885710208:0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.951905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498963.951925:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498963.951930:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885710464:0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.951951:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498963.951990:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710592 00000100:00100000:0.0:1789498963.951997:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710592 00000100:00100000:0.0:1789498963.952043:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710720 00000100:00100000:0.0:1789498963.952046:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710720 00000100:00100000:0.0:1789498963.952060:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710464 00000100:00100000:0.0:1789498963.952062:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710464 00000100:00100000:0.0:1789498963.952077:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498963.952084:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885710592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.952174:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885710592:12345-0@lo:400:kworker.0 Request processed in 90us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498963.952182:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498963.952207:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498963.952213:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885710720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.952254:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885710720:12345-0@lo:400:kworker.0 Request processed in 41us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498963.952260:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498963.952275:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498963.952281:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885710464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498963.952313:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885710464:12345-0@lo:400:kworker.0 Request processed in 32us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498963.952318:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789498963.952352:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb40df80 x1876424885710464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498963.952366:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885710464:0@lo:400:kworker.0 00010000:00080000:0.0:1789498963.952396:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb40ce00 x1876424885710720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498963.952406:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885710720:0@lo:400:kworker.0 00010000:00080000:0.0:1789498963.952415:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb40f800 x1876424885710592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498963.952422:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885710592:0@lo:400:kworker.0 00000100:00100000:2.0:1789498963.952669:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710208 00000100:00100000:2.0:1789498963.952675:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710208 00000100:00100000:2.0:1789498963.952722:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498963.952729:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3305:x1876424885710208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498963.952768:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3305:x1876424885710208:12345-0@lo:400:kworker.0 Request processed in 40us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498963.952785:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498963.952819:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885710208:0@lo:400:kworker.0 00000100:00100000:3.0:1789498963.953325:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710336 00000100:00100000:3.0:1789498963.953331:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710336 00000100:00100000:3.0:1789498963.953367:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498963.953372:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876424885710336:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789498963.953410:0:24599:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 863 last 0 00000020:00000080:3.0:1789498963.953445:0:24599:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3a6cb1946bc19ede 00002000:00100000:3.0:1789498963.953460:0:24599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98eac0ae6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789498963.953465:0:24599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789498963.953467:0:24599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789498963.953841:0:24599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789498963.953864:0:24599:0:(import.c:65:import_set_state_nolock()) ffff98eac0ae4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498963.953931:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876424885710336:12345-0@lo:8:kworker.0 Request processed in 557us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498963.953938:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789498963.953961:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789498963.953994:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eabb40d880 x1876424885710336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498963.954004:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498963.954012:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789498963.954019:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789498963.954025:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789498963.954027:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98ea83f8b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789498963.954040:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789498963.954045:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876424885710336:0@lo:8:kworker.0 00000004:00080000:3.0:1789498963.954142:0:23942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:3.0:1789498963.954164:0:23942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23942:1876424885710976:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789498963.954196:0:23942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498963.954218:0:23942:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498963.954229:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498963.954237:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885710848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498963.954272:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498963.954307:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710848 00000100:00100000:3.0:1789498963.954311:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710848 00000100:00100000:3.0:1789498963.954349:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498963.954356:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885710848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498963.954380:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498963.954416:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876424885710848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498963.954422:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789498963.954438:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789498963.954454:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eab9fa3100 x1876424885710848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498963.954469:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885710848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498963.954902:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885710976 00000100:00100000:2.0:1789498963.954908:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885710976 00000100:00100000:2.0:1789498963.954948:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498963.954956:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23942:x1876424885710976:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789498963.962320:0:23941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789498963.962744:0:23941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863726652772ns, next at 0ns, rc = 0 00002000:00080000:2.0:1789498963.968318:0:24602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789498963.968331:0:24602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789498963.968337:0:24602:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:2.0:1789498963.990443:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498963.990456:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990488:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498963.990492:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498963.990499:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990518:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990529:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990537:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990559:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498963.990574:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498963.990592:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990601:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498963.990606:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990615:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990645:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990652:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19ee5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.990669:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498963.990671:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498963.990674:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498963.991277:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498963.991284:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991293:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498963.991297:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498963.991302:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991312:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991320:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991327:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991355:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498963.991366:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498963.991370:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991377:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498963.991381:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991389:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991401:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991408:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19eec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.991420:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498963.991421:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498963.991423:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498963.998001:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498963.998018:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.998037:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498963.998055:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498963.998063:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.998079:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.999965:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498963.999984:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.001006:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789498964.010976:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.010994:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.011014:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.011019:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.011026:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.011052:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.011065:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.011073:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.011822:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498964.012046:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498964.012055:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012066:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.012071:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012081:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012113:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012285:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19ef3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012309:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.012313:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012320:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.012323:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012331:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012343:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012350:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19efa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.012363:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.012365:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.012366:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.012394:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.017503:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.017519:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.017537:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.017542:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.017548:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.017563:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.017573:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.017593:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.017613:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498964.021162:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.021178:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.021202:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.021208:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.021221:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.021245:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.021253:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6e78dcb/0x3a6cb1946bc19f01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.021274:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.021276:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.021277:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.025220:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.025233:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025251:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.025255:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.025262:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025278:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025289:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025298:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025321:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498964.025335:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498964.025340:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025355:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498964.025360:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025370:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025387:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025395:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edece221/0x3a6cb1946bc19f08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.025416:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.025418:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.025420:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.031236:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.031654:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031672:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.031676:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.031851:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031869:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031890:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031908:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031932:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498964.031946:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498964.031951:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031959:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498964.031964:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.031973:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.032000:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.032009:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a4134b8/0x3a6cb1946bc19f0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.032028:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.032037:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.032039:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.042983:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.043454:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.043472:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.043477:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.043483:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.043499:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.043510:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.043517:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.043543:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.044072:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.044081:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.044104:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.044110:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.044120:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.044140:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.044147:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000449ee8b6/0x3a6cb1946bc19f16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.044168:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.044170:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.044179:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.050452:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.050468:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.050487:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.050491:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.050498:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.050526:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.050536:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.050544:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.050571:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.051141:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.051150:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.051159:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.051163:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.051173:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.051191:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.051199:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc19f1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.051220:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.051222:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.051224:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.053734:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.053748:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.053767:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.053783:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.053790:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.053804:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.053815:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.053837:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.053863:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.056052:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.056066:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.056081:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.056086:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.056135:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.056156:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.056164:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000147245f1/0x3a6cb1946bc19f24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.056191:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.056193:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.056195:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.062242:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.064123:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064143:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.064148:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.064156:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064173:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064186:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064194:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064216:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498964.064231:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498964.064237:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064453:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498964.064457:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064468:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064486:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064493:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19f2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.064516:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.064518:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.064520:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.069438:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.069454:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.069472:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.069477:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.069483:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.069497:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.069517:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.069526:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.069551:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498964.070997:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.071011:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.071155:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.071161:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.071173:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.071205:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.071213:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abec61f/0x3a6cb1946bc19f32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.071236:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.071238:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.071240:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.075223:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.075237:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075254:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.075259:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.075265:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075281:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075292:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075300:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075330:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.075432:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.075440:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.075449:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.075454:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.075463:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.075481:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.075501:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001eddf8f/0x3a6cb1946bc19f39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.075519:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.075521:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.075523:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.075724:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.075730:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075739:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.075742:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.075747:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075756:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.075764:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.078282:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.078317:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498964.078415:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.078425:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.078434:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.078439:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.078449:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.078467:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.078474:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a2f419/0x3a6cb1946bc19f40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.078503:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.078505:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.078507:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.079719:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.079730:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.079745:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.080115:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.080124:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.080140:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.080150:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.080158:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.080182:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498964.080764:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.080780:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.080789:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.080794:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.080803:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.080820:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.080827:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9ab73c/0x3a6cb1946bc19f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.080847:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.080848:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.080850:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.081355:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.081363:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.081374:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.081378:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.081383:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.081394:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.081403:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.081421:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.081441:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498964.081472:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.081477:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.081495:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.081499:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.081507:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.081518:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.081525:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc92d25/0x3a6cb1946bc19f4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.081539:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.081540:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.081542:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.086721:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.086737:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.086882:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.086888:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.086896:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.086982:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.087231:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.087242:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.087333:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498964.088004:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.088014:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.088023:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.088028:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.088038:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.088813:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.088826:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17166d5/0x3a6cb1946bc19f55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.088969:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.088972:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.088974:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789498964.089140:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789498964.090975:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.090987:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091240:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.091254:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.091263:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091280:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091293:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091301:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091322:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.091603:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.091610:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.091618:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25800 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.091623:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.091631:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.091647:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.091654:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008af587dd/0x3a6cb1946bc19f5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.091672:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.091674:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.091675:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.091843:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.091849:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091858:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.091862:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.091866:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091874:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.091893:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.096195:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.096230:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.096283:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.096293:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.096303:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.096308:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.096319:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.096351:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.096359:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090464f64/0x3a6cb1946bc19f63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.096384:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.096385:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.096387:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498964.097374:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789498964.097382:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.097397:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1789498964.097402:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498964.097408:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.097426:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.097436:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.097444:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.097475:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.097820:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.097828:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.097836:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.097840:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.097860:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.097874:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.097881:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ed8d61/0x3a6cb1946bc19f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.097900:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.097902:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.097903:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.100871:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.100886:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.100903:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.100908:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.100915:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.100929:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.100939:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.100948:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.100978:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498964.101274:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.101282:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.101290:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.101294:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.101303:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.101319:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.101346:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d46f7256/0x3a6cb1946bc19f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.101365:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.101367:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.101369:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.102904:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.102915:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.102932:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.102937:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.102942:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.102953:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.102962:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.102969:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.103041:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498964.103830:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.103837:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.103848:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.103851:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.103855:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.103877:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.103886:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.103893:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105235:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498964.105246:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105267:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.105272:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105283:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105303:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105310:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052aabd48/0x3a6cb1946bc19f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105330:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498964.105334:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105359:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498964.105363:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105371:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105380:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.105388:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.105389:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.105391:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.116038:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789498964.116067:0:24602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0df8ea0/0x3a6cb1946bc19f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.116921:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.117509:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.117518:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.117534:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.117539:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.117545:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.117560:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.117643:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.117652:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.117679:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498964.117882:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498964.117891:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.117899:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498964.117904:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.117913:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.117931:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.117949:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cf7a8e/0x3a6cb1946bc19f86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.117970:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.117972:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.117973:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.125275:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.125291:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.125311:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.125316:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.125323:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.125349:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.125362:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.125371:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.125413:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498964.125748:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498964.125765:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.125782:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498964.125787:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.125809:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.125828:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.125836:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ab649f/0x3a6cb1946bc19f8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.125856:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.125858:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.125860:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.126022:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.126028:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126038:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.126041:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.126046:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126055:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126065:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126072:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126111:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498964.126517:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.126524:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126534:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.126543:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.126548:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126557:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126566:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126572:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.126594:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789498964.126764:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498964.126778:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126787:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498964.126791:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126798:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126811:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126828:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022fe6cf3/0x3a6cb1946bc19f94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126842:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498964.126846:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126852:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6554400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498964.126854:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126861:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126871:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126878:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c7aa434/0x3a6cb1946bc19f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.126889:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.126891:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.126893:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498964.128353:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.133487:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.133501:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.133520:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.133525:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.133532:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.133547:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.133558:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.133573:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.133598:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498964.133738:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498964.133746:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.133762:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555200 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498964.133779:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.133789:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.133806:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.133814:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dae647a/0x3a6cb1946bc19fa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.133836:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.133837:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498964.133839:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498964.134446:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.134452:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.134461:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.134465:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.134469:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.134479:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.134487:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.134493:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.134553:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789498964.134990:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789498964.134996:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.135010:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1789498964.135013:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498964.135018:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.136910:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.136923:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.136930:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.141497:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498964.141514:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.141530:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eab6555a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498964.141544:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.141557:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142540:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142555:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb81210/0x3a6cb1946bc19fa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142593:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498964.142597:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142604:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498964.142607:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142615:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142628:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498964.142636:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.142644:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498964.142647:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.144673:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789498964.144687:0:24602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000527414b/0x3a6cb1946bc19fb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498964.144796:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498964.152400:0:24602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789498964.152419:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.152440:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=863s v=(0 0) 00010000:00010000:1.0:1789498964.152444:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498964.152451:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.152466:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.152493:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.152502:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498964.152524:0:24602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789498964.152833:0:24602:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:1.0:1789498964.152929:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23942:x1876424885710976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 197971us (198728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498964.152950:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498964.152965:0:23942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23942:1876424885710976:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789498964.152982:0:23942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:3.0:1789498964.153041:0:23942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23942:1876424885711104:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789498964.153075:0:23942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498964.153141:0:23942:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498964.153217:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711104 00000100:00100000:1.0:1789498964.153224:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711104 00000100:00100000:1.0:1789498964.153272:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498964.153281:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23942:x1876424885711104:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789498964.153321:0:24599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:2.0:1789498964.155657:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498964.155669:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.155682:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498964.155688:0:23906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.155711:0:23906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.155734:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.155742:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a095a80f/0x3a6cb1946bc19fb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498964.155840:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.155842:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498964.155844:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498964.163766:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:23942:x1876424885711104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10474us (10678us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789498964.163791:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498964.177281:0:23942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23942:1876424885711104:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789498964.177304:0:23942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:3.0:1789498964.524813:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789498964.642484:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1789498964.642514:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789498965.548363:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498966.571371:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498967.596341:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789498967.918038:0:25680:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789498968.556846:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885711232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498968.556921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498968.556996:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711232 00000100:00100000:3.0:1789498968.557005:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711232 00000100:00100000:3.0:1789498968.557078:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498968.557112:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885711232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498968.557155:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789498968.559264:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885711232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2173us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498968.559275:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789498968.559306:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498968.560387:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885711232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498968.641948:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498969.092607:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885711360:0@lo:400:kworker.0 00000100:00100000:0.0:1789498969.092711:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498969.092763:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885711872:0@lo:400:kworker.0 00000100:00100000:0.0:1789498969.092791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498969.092818:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498969.092823:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885711488:0@lo:400:kworker.0 00000100:00100000:0.0:1789498969.092848:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498969.092890:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711872 00000100:00100000:0.0:1789498969.092899:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711872 00000100:00100000:0.0:1789498969.092972:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789498969.092982:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885711872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498969.093036:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885711872:12345-0@lo:400:kworker.0 Request processed in 55us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498969.093043:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789498969.093064:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789498969.093114:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eac1cfd500 x1876424885711872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498969.093129:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885711872:0@lo:400:kworker.0 00000100:00100000:2.0:1789498969.093674:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885712000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498969.093724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498969.093761:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885711616:0@lo:400:kworker.0 00000100:00100000:2.0:1789498969.093783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498969.093804:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498969.093810:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885711744:0@lo:400:kworker.0 00000100:00100000:2.0:1789498969.093830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498969.093863:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712000 00000100:00100000:2.0:1789498969.093875:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712000 00000100:00100000:2.0:1789498969.093915:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498969.093923:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885712000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498969.093967:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498969.094009:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885712000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498969.094016:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498969.094038:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711616 00000100:00100000:2.0:1789498969.094043:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711616 00000100:00100000:2.0:1789498969.094064:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711744 00000100:00100000:2.0:1789498969.094067:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711744 00000100:00100000:2.0:1789498969.094086:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498969.094109:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885711616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498969.094145:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876424885711616:12345-0@lo:400:kworker.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498969.094151:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498969.094161:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498969.094167:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885711744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498969.094204:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885711744:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498969.094209:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789498969.094231:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498969.094234:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498969.094252:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789498969.094272:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885712000:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789498969.094295:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eac1cfc000 x1876424885711744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498969.094317:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885711744:0@lo:400:kworker.0 00010000:00080000:2.0:1789498969.094330:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98eac1cfd180 x1876424885711616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498969.094337:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876424885711616:0@lo:400:kworker.0 00000100:00100000:3.0:1789498969.099263:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711360 00000100:00100000:3.0:1789498969.099280:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711360 00000100:00100000:3.0:1789498969.099348:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789498969.099358:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3307:x1876424885711360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498969.099465:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3307:x1876424885711360:12345-0@lo:400:kworker.0 Request processed in 108us (6754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498969.099473:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789498969.099760:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885711360:0@lo:400:kworker.0 00000100:00100000:0.0:1789498969.102622:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885711488 00000100:00100000:0.0:1789498969.102643:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885711488 00000100:00100000:0.0:1789498969.102719:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498969.102730:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885711488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498969.102826:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885711488:12345-0@lo:400:kworker.0 Request processed in 99us (9976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498969.102841:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498969.103210:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885711488:0@lo:400:kworker.0 00010000:00010000:2.0:1789498969.647610:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498970.692779:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498970.991536:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789498971.352704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.352737:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736384 00000100:00100000:3.0:1789498971.352747:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736384 00000100:00100000:3.0:1789498971.352781:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1789498971.352790:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2354:x1876424864736384:12345-192.168.201.20@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789498971.352816:0:23912:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715@192.168.201.20@tcp t0 exp 0000000000000000 cur 871 last 0 00000020:00000080:3.0:1789498971.352845:0:23912:0:(genops.c:1384:class_connect()) connect: client 4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715, cookie 0x3a6cb1946bc19fbe 00000100:00080000:3.0:1789498971.353005:0:23912:0:(import.c:65:import_set_state_nolock()) ffff98eac0ae6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498971.353065:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+5:2354:x1876424864736384:12345-192.168.201.20@tcp:250:mount.lustre.0 Request processed in 275us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.353072:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:2.0:1789498971.365331:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498971.365373:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736512 00000100:00100000:2.0:1789498971.365385:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736512 00000100:00100000:2.0:1789498971.365437:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:2.0:1789498971.365447:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+5:17702:x1876424864736512:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498971.365465:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498971.365482:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa5a00/0x3a6cb1946bc19fc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a62e expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498971.365513:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa5a00/0x3a6cb1946bc19fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a62e expref: 6 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498971.365524:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa5a00/0x3a6cb1946bc19fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a62e expref: 6 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498971.365534:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5a00, rc 0) 00000100:00100000:2.0:1789498971.365583:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+6:17702:x1876424864736512:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 137us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498971.365590:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:2.0:1789498971.373835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498971.373913:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736640 00000100:00100000:1.0:1789498971.373932:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736640 00000100:00100000:1.0:1789498971.373983:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498971.374007:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+6:17702:x1876424864736640:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498971.374376:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+6:17702:x1876424864736640:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 369us (551us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789498971.374385:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1789498971.382529:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.382590:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736768 00000100:00100000:3.0:1789498971.382600:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736768 00000100:00100000:3.0:1789498971.382686:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1789498971.382697:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+6:17702:x1876424864736768:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789498971.382714:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498971.382731:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19fcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a635 expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.382761:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a635 expref: 7 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.382773:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddf200/0x3a6cb1946bc19fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a635 expref: 7 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.382782:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddf200, rc 0) 00000100:00100000:3.0:1789498971.382839:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+7:17702:x1876424864736768:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.382846:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1789498971.389384:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.389626:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864736896 00000100:00100000:0.0:1789498971.389636:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864736896 00000100:00100000:0.0:1789498971.389730:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1789498971.389740:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+7:17702:x1876424864736896:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789498971.390201:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17702:x1876424864736896:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 461us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.390209:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:2.0:1789498971.393816:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.393891:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737024 00000100:00100000:3.0:1789498971.393901:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737024 00000100:00100000:3.0:1789498971.393962:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:3.0:1789498971.393971:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17702:x1876424864737024:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789498971.394797:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17702:x1876424864737024:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 825us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498971.394806:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1789498971.401560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.401850:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737152 00000100:00100000:0.0:1789498971.401862:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737152 00000100:00100000:0.0:1789498971.401928:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:0.0:1789498971.401939:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17720:x1876424864737152:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498971.402706:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17720:x1876424864737152:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 765us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.402715:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:0.0:1789498971.431851:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498971.432884:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737280 00000100:00100000:2.0:1789498971.432896:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737280 00000100:00100000:2.0:1789498971.432953:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1789498971.432963:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17720:x1876424864737280:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498971.433303:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17720:x1876424864737280:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 340us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498971.433312:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1789498971.438567:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.438673:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737408 00000100:00100000:0.0:1789498971.438684:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737408 00000100:00100000:0.0:1789498971.438738:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1789498971.438748:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+8:17702:x1876424864737408:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789498971.438767:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498971.438787:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad25200/0x3a6cb1946bc19fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a65f expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498971.438817:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad25200/0x3a6cb1946bc19fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a65f expref: 9 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498971.438843:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad25200/0x3a6cb1946bc19fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a65f expref: 9 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498971.438853:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25200, rc 0) 00000100:00100000:0.0:1789498971.439991:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+9:17702:x1876424864737408:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 1238us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.440001:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:3.0:1789498971.460201:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498971.460392:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737536 00000100:00100000:1.0:1789498971.460403:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737536 00000100:00100000:1.0:1789498971.460456:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:1.0:1789498971.460465:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+9:17702:x1876424864737536:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789498971.460491:0:23910:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789498971.460507:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789498971.460512:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789498971.460515:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789498971.460518:0:23910:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1789498971.464594:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+9:17702:x1876424864737536:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 4116us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.464613:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:3.0:1789498971.468398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.468572:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737664 00000100:00100000:0.0:1789498971.468584:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737664 00000100:00100000:0.0:1789498971.468682:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:0.0:1789498971.468692:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+9:17702:x1876424864737664:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789498971.468713:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498971.468738:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a666 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498971.468772:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 10 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498971.468784:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 10 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498971.468792:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad24a00, rc 0) 00000100:00100000:0.0:1789498971.468853:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17702:x1876424864737664:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 161us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.468860:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:0.0:1789498971.474236:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.474661:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737792 00000100:00100000:3.0:1789498971.474672:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737792 00000100:00100000:3.0:1789498971.474779:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:3.0:1789498971.474791:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17702:x1876424864737792:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789498971.475136:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17702:x1876424864737792:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 348us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.475145:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:1.0:1789498971.477675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.477780:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864737920 00000100:00100000:0.0:1789498971.477791:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864737920 00000100:00100000:0.0:1789498971.477881:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1789498971.477890:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17702:x1876424864737920:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789498971.478313:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17702:x1876424864737920:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 423us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.478321:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1789498971.481274:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.481476:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738048 00000100:00100000:3.0:1789498971.481485:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738048 00000100:00100000:3.0:1789498971.481575:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:3.0:1789498971.481586:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17723:x1876424864738048:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498971.481868:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17723:x1876424864738048:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 284us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.481877:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:3.0:1789498971.489332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.489433:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738176 00000100:00100000:0.0:1789498971.489443:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738176 00000100:00100000:0.0:1789498971.489494:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:0.0:1789498971.489504:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17723:x1876424864738176:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498971.489756:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17723:x1876424864738176:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 252us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.489764:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:1.0:1789498971.492914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498971.493006:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738304 00000100:00100000:2.0:1789498971.493016:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738304 00000100:00100000:2.0:1789498971.493066:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1789498971.493074:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1876424864738304:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789498971.493124:0:23919:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3440e60a-8ca4-432e-ae5e-d35d9331aa73@192.168.201.20@tcp t0 exp 0000000000000000 cur 871 last 0 00000020:00000080:2.0:1789498971.493171:0:23919:0:(genops.c:1384:class_connect()) connect: client 3440e60a-8ca4-432e-ae5e-d35d9331aa73, cookie 0x3a6cb1946bc19fe1 00000004:00100000:2.0:1789498971.493203:0:23919:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789498971.493209:0:23919:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1789498971.555822:0:23919:0:(import.c:65:import_set_state_nolock()) ffff98e984418800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498971.555909:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2354:x1876424864738304:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 62832us (63003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498971.555920:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1789498971.561294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498971.561627:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738432 00000100:00100000:2.0:1789498971.561648:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738432 00000100:00100000:2.0:1789498971.561723:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1789498971.561734:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:0:x1876424864738432:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498971.561806:0:23917:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789498971.561890:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:0:x1876424864738432:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 157us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498971.561898:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1789498971.562030:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00080000:0.0:1789498971.562139:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498971.562349:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738560 00000100:00100000:3.0:1789498971.562355:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738560 00000100:00100000:3.0:1789498971.562390:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1789498971.562398:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17702:x1876424864738560:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789498971.567868:0:23918:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789498971.567968:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17702:x1876424864738560:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 5564us (5933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.567995:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1789498971.573679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.575590:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738688 00000100:00100000:0.0:1789498971.575604:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738688 00000100:00100000:0.0:1789498971.575719:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498971.575730:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17702:x1876424864738688:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789498971.575835:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17702:x1876424864738688:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 107us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.575843:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1789498971.577881:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.580940:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738816 00000100:00100000:3.0:1789498971.580954:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738816 00000100:00100000:2.0:1789498971.581133:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498971.581164:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498971.581284:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739072 00000100:00100000:0.0:1789498971.581288:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739072 00000100:00100000:0.0:1789498971.581327:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1789498971.581354:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:2355:x1876424864739072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498971.581444:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:2355:x1876424864739072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498971.581452:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:3.0:1789498971.584688:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864738944 00000100:00100000:3.0:1789498971.584703:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864738944 00000100:00100000:3.0:1789498971.584765:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1789498971.584774:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864738816:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789498971.584805:0:24601:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3440e60a-8ca4-432e-ae5e-d35d9331aa73@192.168.201.20@tcp t0 exp 0000000000000000 cur 871 last 0 00000020:00000080:3.0:1789498971.584835:0:24601:0:(genops.c:1384:class_connect()) connect: client 3440e60a-8ca4-432e-ae5e-d35d9331aa73, cookie 0x3a6cb1946bc19fe8 00002000:00100000:3.0:1789498971.584846:0:24601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3440e60a-8ca4-432e-ae5e-d35d9331aa73/ffff98eac0ae7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789498971.584881:0:24601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789498971.585208:0:24601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789498971.585241:0:24601:0:(import.c:65:import_set_state_nolock()) ffff98eac0ae5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498971.585307:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2354:x1876424864738816:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 532us (7431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.585316:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1789498971.585335:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:3.0:1789498971.585339:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864738944:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789498971.585353:0:24601:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3440e60a-8ca4-432e-ae5e-d35d9331aa73@192.168.201.20@tcp t0 exp 0000000000000000 cur 871 last 0 00000020:00000080:3.0:1789498971.585368:0:24601:0:(genops.c:1384:class_connect()) connect: client 3440e60a-8ca4-432e-ae5e-d35d9331aa73, cookie 0x3a6cb1946bc19fef 00002000:00100000:3.0:1789498971.585373:0:24601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3440e60a-8ca4-432e-ae5e-d35d9331aa73/ffff98eac0ae0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789498971.585387:0:24601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789498971.585593:0:24601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789498971.585607:0:24601:0:(import.c:65:import_set_state_nolock()) ffff98eac0ae4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498971.585657:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2354:x1876424864738944:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 315us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.585664:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1789498971.592644:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.593348:0:23920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739200 00000100:00100000:3.0:1789498971.593362:0:23920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739200 00000100:00100000:2.0:1789498971.593585:0:23920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498971.593596:0:23920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17702:x1876424864739200:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789498971.602319:0:23920:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8635us 00000004:00200000:1.0:1789498971.629148:0:23920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789498971.629283:0:23920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17702:x1876424864739200:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 35683us (36654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498971.629297:0:23920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00010000:00010000:2.0:1789498971.691550:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498971.933087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498971.933331:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739328 00000100:00100000:3.0:1789498971.933342:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739328 00000100:00100000:3.0:1789498971.933425:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1789498971.933436:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17744:x1876424864739328:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1789498971.933459:0:23918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498971.933497:0:23918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde200/0x3a6cb1946bc19ff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a690 expref: -99 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.933579:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19ffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.933592:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.933605:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498971.933661:0:23918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789498971.933665:0:23918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498971.933703:0:23918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.933727:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde200/0x3a6cb1946bc19ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a690 expref: 8 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.933771:0:23918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a690 expref: 7 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498971.933779:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:3.0:1789498971.933782:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498971.933785:0:23918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddee00, rc 0) 00000100:00100000:3.0:1789498971.934186:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:17744:x1876424864739328:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 752us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498971.934194:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00010000:00010000:3.0:1789498972.716648:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498973.676343:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498973.676366:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885712128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498973.676445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498973.676585:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712128 00000100:00100000:0.0:1789498973.676594:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712128 00000100:00100000:0.0:1789498973.676667:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789498973.676677:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885712128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498973.676713:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498973.676771:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885712128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498973.676779:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789498973.677109:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498973.677316:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885712128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498973.739865:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498974.156187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498974.159861:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739456 00000100:00100000:1.0:1789498974.159876:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739456 00000100:00100000:1.0:1789498974.159969:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498974.159979:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:17797:x1876424864739456:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1789498974.160027:0:23919:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789498974.160144:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:17797:x1876424864739456:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 166us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498974.160152:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00080000:0.0:1789498974.160191:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498974.169021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498974.173049:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739584 00000100:00100000:0.0:1789498974.173063:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739584 00000100:00100000:0.0:1789498974.173802:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498974.173815:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17797:x1876424864739584:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1789498974.173842:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789498974.173916:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498974.173941:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17797:x1876424864739584:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 128us (4929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.173950:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1789498974.176888:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498974.176981:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739712 00000100:00100000:0.0:1789498974.176991:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739712 00000100:00100000:0.0:1789498974.177171:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498974.177182:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17797:x1876424864739712:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1789498974.177223:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498974.177329:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:17797:x1876424864739712:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 148us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.177338:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00080000:1.0:1789498974.178020:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498974.191727:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885712384:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.191819:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498974.191885:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498974.191892:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885712512:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.191919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498974.191956:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885712640:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.191980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498974.191998:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789498974.192022:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885712256:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.192050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498974.192073:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885712768:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.192126:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498974.192153:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712256 00000100:00100000:2.0:1789498974.192170:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712256 00000100:00100000:2.0:1789498974.192226:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789498974.192236:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3305:x1876424885712256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.192676:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3305:x1876424885712256:12345-0@lo:400:kworker.0 Request processed in 439us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.192685:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789498974.192718:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712512 00000100:00100000:2.0:1789498974.192725:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712512 00000100:00100000:2.0:1789498974.192749:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712640 00000100:00100000:2.0:1789498974.192752:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712640 00000100:00100000:2.0:1789498974.192771:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712768 00000100:00100000:2.0:1789498974.192773:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712768 00000100:00100000:2.0:1789498974.192786:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498974.192808:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.192850:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885712512:12345-0@lo:400:kworker.0 Request processed in 58us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.192856:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498974.192866:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498974.192872:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885712640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.192896:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885712640:12345-0@lo:400:kworker.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.192902:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498974.192922:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498974.192928:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885712768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.192957:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885712768:12345-0@lo:400:kworker.0 Request processed in 30us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.192963:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789498974.192997:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885712256:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.193012:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885712768:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.193022:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885712640:0@lo:400:kworker.0 00000100:00100000:2.0:1789498974.193053:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885712512:0@lo:400:kworker.0 00000100:00100000:3.0:1789498974.193582:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712384 00000100:00100000:3.0:1789498974.193599:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712384 00000100:00100000:3.0:1789498974.193640:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498974.193649:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885712384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498974.193697:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885712384:12345-0@lo:400:kworker.0 Request processed in 50us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.193704:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498974.193737:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98ea864d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885712384:0@lo:400:kworker.0 00000100:00080000:1.0:1789498974.193998:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498974.194005:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498974.194121:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885712896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498974.194179:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498974.194851:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885712896 00000100:00100000:0.0:1789498974.194859:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885712896 00000100:00100000:0.0:1789498974.194895:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498974.194902:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885712896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498974.194921:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789498974.194979:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885712896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.194986:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498974.199821:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885712896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498974.528318:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498974.528527:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739840 00000100:00100000:0.0:1789498974.528539:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739840 00000100:00100000:0.0:1789498974.528617:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:0.0:1789498974.528629:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+10:17832:x1876424864739840:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789498974.528647:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498974.528666:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabad25800/0x3a6cb1946bc1a004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a697 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498974.528698:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad25800/0x3a6cb1946bc1a004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a697 expref: 11 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498974.528712:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabad25800/0x3a6cb1946bc1a004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a697 expref: 11 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498974.528721:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25800, rc 0) 00000100:00100000:0.0:1789498974.528786:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17832:x1876424864739840:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 159us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.528810:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:2.0:1789498974.539065:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498974.541995:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864739968 00000100:00100000:0.0:1789498974.542012:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864739968 00000100:00100000:0.0:1789498974.542143:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:0.0:1789498974.542166:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17832:x1876424864739968:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789498974.543312:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17832:x1876424864739968:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 1154us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.543323:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1789498974.553801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498974.554013:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740096 00000100:00100000:2.0:1789498974.554024:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740096 00000100:00100000:2.0:1789498974.554111:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:2.0:1789498974.554120:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba1eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17832:x1876424864740096:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789498974.554703:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba1eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17832:x1876424864740096:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 581us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.554711:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:2.0:1789498974.561135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498974.561979:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740224 00000100:00100000:1.0:1789498974.561992:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740224 00000100:00100000:1.0:1789498974.562057:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:1.0:1789498974.562070:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17837:x1876424864740224:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498974.562379:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17837:x1876424864740224:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 309us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498974.562388:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:3.0:1789498974.596234:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498974.614538:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740352 00000100:00100000:0.0:1789498974.614554:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740352 00000100:00100000:0.0:1789498974.614637:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:0.0:1789498974.614648:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17837:x1876424864740352:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498974.614971:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17837:x1876424864740352:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 324us (18746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.614979:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:3.0:1789498974.625286:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498974.625394:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740480 00000100:00100000:2.0:1789498974.625404:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740480 00000100:00100000:2.0:1789498974.625460:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1789498974.625470:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17832:x1876424864740480:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498974.625487:0:23912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498974.625517:0:23912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa4000/0x3a6cb1946bc1a00b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a6c1 expref: -99 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498974.625547:0:23912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa4000/0x3a6cb1946bc1a00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c1 expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498974.625558:0:23912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa4000/0x3a6cb1946bc1a00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c1 expref: 12 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498974.625566:0:23912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4000, rc 0) 00000100:00100000:2.0:1789498974.625632:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17832:x1876424864740480:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.625639:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:3.0:1789498974.628759:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498974.628998:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740608 00000100:00100000:1.0:1789498974.629008:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740608 00000100:00100000:1.0:1789498974.629061:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:1.0:1789498974.629070:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17832:x1876424864740608:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789498974.629139:0:23910:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789498974.629167:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789498974.629171:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789498974.629180:0:23910:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789498974.629182:0:23910:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:1.0:1789498974.631678:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17832:x1876424864740608:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 2598us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498974.631693:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:0.0:1789498974.642797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498974.643126:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740736 00000100:00100000:2.0:1789498974.643138:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740736 00000100:00100000:2.0:1789498974.643200:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:2.0:1789498974.643211:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17832:x1876424864740736:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498974.643230:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498974.643249:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a6c8 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498974.643280:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 13 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498974.643292:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 13 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498974.643301:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4400, rc 0) 00000100:00100000:2.0:1789498974.643367:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17832:x1876424864740736:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 158us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.643386:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:3.0:1789498974.646058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498974.646127:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740864 00000100:00100000:1.0:1789498974.646139:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740864 00000100:00100000:1.0:1789498974.646197:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:1.0:1789498974.646209:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17832:x1876424864740864:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498974.646541:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17832:x1876424864740864:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 333us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498974.646550:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:3.0:1789498974.655485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498974.656513:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864740992 00000100:00100000:0.0:1789498974.656526:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864740992 00000100:00100000:0.0:1789498974.656626:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:0.0:1789498974.656638:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17832:x1876424864740992:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789498974.656908:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17832:x1876424864740992:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 271us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.656916:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:0.0:1789498974.664169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498974.665764:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741120 00000100:00100000:2.0:1789498974.665780:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741120 00000100:00100000:2.0:1789498974.665854:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:2.0:1789498974.665865:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17840:x1876424864741120:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498974.666178:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17840:x1876424864741120:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 314us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.666186:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:3.0:1789498974.679215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498974.689570:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741248 00000100:00100000:1.0:1789498974.689599:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741248 00000100:00100000:1.0:1789498974.689681:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:1.0:1789498974.689692:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17840:x1876424864741248:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498974.690818:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17840:x1876424864741248:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 1120us (11607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498974.690829:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 105 00000100:00100000:3.0:1789498974.736710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.736864:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.736896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.736927:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.736963:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741888 00000100:00100000:3.0:1789498974.736974:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741888 00000100:00100000:3.0:1789498974.737026:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742016 00000100:00100000:3.0:1789498974.737029:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742016 00000100:00100000:3.0:1789498974.737064:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498974.737083:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2357:x1876424864741888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498974.737251:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2357:x1876424864741888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.737260:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498974.737284:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498974.737292:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2357:x1876424864742016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498974.737324:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2357:x1876424864742016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.737344:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498974.740022:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741376 00000100:00100000:3.0:1789498974.740038:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741376 00000100:00100000:3.0:1789498974.740075:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741760 00000100:00100000:3.0:1789498974.740078:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741760 00000100:00100000:3.0:1789498974.740144:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1789498974.740221:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2357:x1876424864741760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498974.740295:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2357:x1876424864741760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (3398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.740303:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1789498974.740319:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1789498974.740324:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1876424864741376:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789498974.740347:0:23917:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d553bf33-c495-43cb-9bd6-6262e7a28bcb@192.168.201.20@tcp t0 exp 0000000000000000 cur 874 last 0 00000020:00000080:3.0:1789498974.740393:0:23917:0:(genops.c:1384:class_connect()) connect: client d553bf33-c495-43cb-9bd6-6262e7a28bcb, cookie 0x3a6cb1946bc1a019 00000004:00100000:3.0:1789498974.740426:0:23917:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789498974.740532:0:23917:0:(import.c:65:import_set_state_nolock()) ffff98ea891f1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498974.740559:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2354:x1876424864741376:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 233us (3861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.740565:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1789498974.777152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498974.777587:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741632 00000100:00100000:2.0:1789498974.777598:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741632 00000100:00100000:2.0:1789498974.777664:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1789498974.777675:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17832:x1876424864741632:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498974.777725:0:23917:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789498974.777800:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17832:x1876424864741632:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 126us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498974.777807:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00080000:1.0:1789498974.778569:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498974.780108:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498974.780228:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864741504 00000100:00100000:1.0:1789498974.780238:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864741504 00000100:00100000:1.0:1789498974.780285:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1789498974.780296:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:0:x1876424864741504:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789498974.780324:0:24829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789498974.780466:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:0:x1876424864741504:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 171us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498974.780474:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00010000:00010000:0.0:1789498974.780480:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498974.782304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.782499:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742144 00000100:00100000:3.0:1789498974.782511:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742144 00000100:00100000:3.0:1789498974.782569:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498974.782589:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17832:x1876424864742144:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789498974.782691:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17832:x1876424864742144:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 114us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.782712:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498974.790903:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.790938:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.790958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498974.790995:0:23921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742528 00000100:00100000:3.0:1789498974.791005:0:23921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742528 00000100:00100000:3.0:1789498974.791051:0:23921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1789498974.791061:0:23921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17832:x1876424864742528:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789498974.791990:0:23921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789498974.792118:0:23921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17832:x1876424864742528:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 1056us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498974.792128:0:23921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1789498974.792484:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742272 00000100:00100000:3.0:1789498974.792494:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742272 00000100:00100000:3.0:1789498974.792599:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742400 00000100:00100000:3.0:1789498974.792603:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742400 00000100:00100000:0.0:1789498974.803152:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498974.803179:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864742272:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498974.803217:0:24601:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d553bf33-c495-43cb-9bd6-6262e7a28bcb@192.168.201.20@tcp t0 exp 0000000000000000 cur 874 last 0 00000020:00000080:0.0:1789498974.803259:0:24601:0:(genops.c:1384:class_connect()) connect: client d553bf33-c495-43cb-9bd6-6262e7a28bcb, cookie 0x3a6cb1946bc1a020 00002000:00100000:0.0:1789498974.803274:0:24601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d553bf33-c495-43cb-9bd6-6262e7a28bcb/ffff98e986273800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498974.803300:0:24601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498974.803558:0:24601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789498974.803608:0:24601:0:(import.c:65:import_set_state_nolock()) ffff98e986276000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498974.803685:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2354:x1876424864742272:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 506us (12744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.803694:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498974.803717:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1789498974.803723:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876424864742400:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498974.803739:0:24601:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d553bf33-c495-43cb-9bd6-6262e7a28bcb@192.168.201.20@tcp t0 exp 0000000000000000 cur 874 last 0 00000020:00000080:0.0:1789498974.804339:0:24601:0:(genops.c:1384:class_connect()) connect: client d553bf33-c495-43cb-9bd6-6262e7a28bcb, cookie 0x3a6cb1946bc1a027 00002000:00100000:0.0:1789498974.804417:0:24601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d553bf33-c495-43cb-9bd6-6262e7a28bcb/ffff98e986270000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498974.804428:0:24601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498974.804628:0:24601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789498974.804654:0:24601:0:(import.c:65:import_set_state_nolock()) ffff98e986274000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498974.804868:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2354:x1876424864742400:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 1140us (13905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498974.804877:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000001:00100000:1.0:1789498974.814123:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3440e60a-8ca4-432e-ae5e-d35d9331aa73 00000001:00100000:2.0:1789498974.817010:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3440e60a-8ca4-432e-ae5e-d35d9331aa73 00000100:00100000:2.0:1789498975.096432:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498975.096536:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742656 00000100:00100000:1.0:1789498975.096548:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742656 00000100:00100000:1.0:1789498975.096625:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1789498975.096636:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:17861:x1876424864742656:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1789498975.096659:0:24829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498975.096684:0:24829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a02e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a6f2 expref: -99 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498975.096747:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498975.096761:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498975.096774:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498975.096816:0:24829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498975.096820:0:24829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498975.096840:0:24829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498975.096865:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a02e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 8 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498975.096894:0:24829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 7 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498975.096918:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:1.0:1789498975.096921:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498975.096925:0:24829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01600, rc 0) 00000100:00100000:1.0:1789498975.096991:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+7:17861:x1876424864742656:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 356us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498975.096998:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00010000:00010000:2.0:1789498975.788274:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789498976.811027:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3440e60a-8ca4-432e-ae5e-d35d9331aa73 00000001:00100000:1.0:1789498976.811052:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d553bf33-c495-43cb-9bd6-6262e7a28bcb 00010000:00010000:0.0:1789498976.812831:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498977.838836:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789498978.349263:0:25884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789498978.795622:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885713024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498978.795711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498978.795934:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713024 00000100:00100000:0.0:1789498978.795943:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713024 00000100:00100000:0.0:1789498978.796033:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498978.796044:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885713024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498978.796114:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789498978.796184:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498978.802379:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885713024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6326us (6656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498978.802395:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498978.804736:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885713024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498978.859265:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498979.307354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498979.307380:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885713152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498979.307455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498979.307659:0:24603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713152 00000100:00100000:1.0:1789498979.307668:0:24603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713152 00000100:00100000:1.0:1789498979.307734:0:24603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498979.307744:0:24603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885713152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498979.307791:0:24603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789498979.307848:0:24603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885713152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498979.307855:0:24603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498979.307910:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885713152:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789498979.307979:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498979.308292:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885713280:0@lo:400:kworker.0 00000100:00100000:3.0:1789498979.308329:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498979.308452:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885713664:0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.308509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498979.308564:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713664 00000100:00100000:2.0:1789498979.308569:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713664 00000100:00100000:2.0:1789498979.308607:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789498979.308615:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885713664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.308660:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876424885713664:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498979.308667:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789498979.308689:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498979.308706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876424885713664:0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.308734:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885713536:0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.308760:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498979.308790:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498979.308796:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885713408:0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.308821:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498979.308907:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713280 00000100:00100000:0.0:1789498979.308912:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713280 00000100:00100000:0.0:1789498979.308945:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789498979.308953:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3306:x1876424885713280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.309027:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713408 00000100:00100000:2.0:1789498979.309031:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713408 00000100:00100000:2.0:1789498979.309061:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498979.309067:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885713408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.309133:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876424885713408:12345-0@lo:400:kworker.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498979.309140:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498979.309164:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876424885713408:0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.309197:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713536 00000100:00100000:2.0:1789498979.309201:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713536 00000100:00100000:2.0:1789498979.309224:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498979.309229:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885713536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498979.309277:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876424885713536:12345-0@lo:400:kworker.0 Request processed in 47us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498979.309283:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498979.309307:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876424885713536:0@lo:400:kworker.0 00000100:00100000:1.0:1789498979.316108:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498979.316128:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885713792:0@lo:400:kworker.0 00000100:00100000:1.0:1789498979.316198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498979.316246:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885713792 00000100:00100000:1.0:1789498979.316255:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885713792 00000100:00100000:1.0:1789498979.316314:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498979.316324:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885713792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498979.316407:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885713792:12345-0@lo:400:kworker.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498979.316414:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789498979.316439:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498979.316467:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885713792:0@lo:400:kworker.0 00000100:00100000:0.0:1789498979.318039:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3306:x1876424885713280:12345-0@lo:400:kworker.0 Request processed in 9080us (9702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498979.318052:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789498979.329265:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8f836406-9642-48a3-887d-ecfcbfd0595e:3306:1876424885713280:0@lo:400:kworker.0 00010000:00010000:1.0:1789498979.885296:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789498979.897314:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d553bf33-c495-43cb-9bd6-6262e7a28bcb 00000001:00100000:1.0:1789498979.943322:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d553bf33-c495-43cb-9bd6-6262e7a28bcb 00000040:00080000:0.0:1789498980.213623:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789498980.244582:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498980.244772:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743040 00000100:00100000:0.0:1789498980.244782:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743040 00000100:00100000:0.0:1789498980.244837:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743552 00000100:00100000:0.0:1789498980.244853:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743552 00000100:00100000:0.0:1789498980.244869:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743168 00000100:00100000:0.0:1789498980.244871:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743168 00000100:00100000:0.0:1789498980.244879:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743424 00000100:00100000:0.0:1789498980.244881:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743424 00000100:00100000:0.0:1789498980.244895:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498980.244903:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864743040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498980.244982:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864743040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498980.244989:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:0.0:1789498980.245005:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498980.245011:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864743552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498980.245031:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864743552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 21us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498980.245037:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498980.245047:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498980.245053:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864743168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498980.245073:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864743168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498980.245079:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1789498980.245140:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:0.0:1789498980.245149:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864743424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1789498980.245173:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864743424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00080000:3.0:1789498980.245185:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498980.245185:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00080000:3.0:1789498980.245196:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498980.245283:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742784 00000100:00100000:1.0:1789498980.245290:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742784 00000100:00100000:1.0:1789498980.245319:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:1.0:1789498980.245326:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:2357:x1876424864742784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498980.245354:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:2357:x1876424864742784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498980.245361:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:2.0:1789498980.245443:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743296 00000100:00100000:2.0:1789498980.245448:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743296 00000100:00100000:2.0:1789498980.245500:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864742912 00000100:00100000:2.0:1789498980.245504:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864742912 00000100:00100000:2.0:1789498980.245527:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498980.245534:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2357:x1876424864743296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498980.245564:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2357:x1876424864743296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498980.245571:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1789498980.245583:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1789498980.245588:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2357:x1876424864742912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498980.245608:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2357:x1876424864742912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498980.245614:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00080000:3.0:1789498980.246376:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789498980.907395:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498981.931355:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498982.955266:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789498983.065225:0:26033:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9f065570 20000000:00000080:0.0:1789498983.065245:0:26033:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e986291800 uarg=0000000000000000 20000000:01000000:0.0:1789498983.065285:0:26033:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789498983.065291:0:26033:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789498983.065297:0:26033:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789498983.066577:0:26034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789498983.067546:0:26033:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789498983.076339:0:26033:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789498983.076373:0:26033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076393:0:26033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 18 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076401:0:26033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 18 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076408:0:26033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 18 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076419:0:26033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 12 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076427:0:26033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 12 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076446:0:26033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076498:0:26033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 12 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076653:0:26033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 12 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498983.076670:0:26033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885713920:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498983.076850:0:26033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 12 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076859:0:26033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 12 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498983.076868:0:26033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714048:192.168.201.20@tcp:104: 00010000:00010000:0.0:1789498983.076897:0:26033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 18 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.076905:0:26033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 18 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498983.076914:0:26033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714176:0@lo:104: 00000100:00100000:0.0:1789498983.077680:0:26033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498983.077745:0:26033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 18 pid: 23912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.077757:0:26033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 18 pid: 23912 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498983.077767:0:26033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714304:0@lo:104: 00000100:00100000:0.0:1789498983.077792:0:26033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498983.077877:0:26033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 18 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.077886:0:26033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 18 pid: 23910 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498983.077896:0:26033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714432:0@lo:104: 00000100:00100000:0.0:1789498983.077920:0:26033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498983.083481:0:26033:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87d7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789498983.087672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498983.087701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498983.088425:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743680 00000100:00100000:3.0:1789498983.088448:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743680 00010000:00010000:3.0:1789498983.088490:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 13 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498983.088654:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743808 00000100:00100000:3.0:1789498983.088659:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743808 00010000:00010000:3.0:1789498983.088674:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 14 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498983.088690:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498983.088699:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+14:2356:x1876424864743680:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498983.088716:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498983.088723:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 14 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498983.088805:0:23902:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789498983.088816:0:23902:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789498983.088861:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 14 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498983.088886:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498983.089601:0:23902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1789498983.089613:0:23902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+14:2356:x1876424864743808:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498983.089625:0:23902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498983.089633:0:23902:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 14 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.089645:0:23902:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 14 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.089658:0:23902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498983.089742:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+14:2356:x1876424864743680:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 1032us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498983.089752:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00010000:00010000:1.0:1789498983.090071:0:26033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa4400/0x3a6cb1946bc1a012 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6c8 expref: 13 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498983.090086:0:26033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885713920:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498983.090120:0:26033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad24a00/0x3a6cb1946bc19fda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a666 expref: 12 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498983.090129:0:26033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714048:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498983.090629:0:23900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714176 00000100:00100000:2.0:1789498983.090637:0:23900:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714176 00000100:00100000:2.0:1789498983.090672:0:23900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714304 00000100:00100000:2.0:1789498983.090676:0:23900:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714304 00000100:00100000:2.0:1789498983.090687:0:23900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714432 00000100:00100000:2.0:1789498983.090689:0:23900:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714432 00000100:00100000:2.0:1789498983.090702:0:23900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498983.090710:0:23900:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+5:26033:x1876424885714176:12345-0@lo:104: 00010000:00010000:2.0:1789498983.090746:0:23900:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.090877:0:23900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498983.090884:0:23900:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+5:26033:x1876424885714176:12345-0@lo:104: Request processed in 175us (13208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498983.090890:0:23900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789498983.090905:0:23900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498983.090911:0:23900:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+4:26033:x1876424885714304:12345-0@lo:104: 00010000:00010000:2.0:1789498983.090929:0:23900:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.090969:0:23900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498983.090974:0:23900:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+4:26033:x1876424885714304:12345-0@lo:104: Request processed in 64us (13182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498983.090980:0:23900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498983.090992:0:23900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498983.091008:0:23900:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+3:26033:x1876424885714432:12345-0@lo:104: 00010000:00010000:2.0:1789498983.091017:0:23900:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091045:0:23900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789498983.091049:0:23900:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9844b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8f836406-9642-48a3-887d-ecfcbfd0595e+3:26033:x1876424885714432:12345-0@lo:104: Request processed in 52us (13129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498983.091054:0:23900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789498983.091139:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789498983.091322:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091339:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde000 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498983.091344:0:23906:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091352:0:23906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498983.091360:0:23906:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498983.091365:0:23906:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498983.091400:0:23906:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091407:0:23906:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498983.091426:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091443:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabadde000/0x3a6cb1946bc19e98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19e9f expref: -99 pid: 25322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091454:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498983.091458:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091463:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5600 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498983.091466:0:23906:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091482:0:23906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498983.091488:0:23906:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498983.091494:0:23906:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498983.091573:0:23906:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091580:0:23906:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498983.091588:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091595:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5600/0x3a6cb1946bc19d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d4f expref: -99 pid: 24598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091604:0:23906:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498983.091607:0:23906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091612:0:23906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabaddfc00 already unused, calling callback (ffffffffc1b04c20) 10000000:00010000:2.0:1789498983.091615:0:23906:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091622:0:23906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498983.091627:0:23906:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498983.091637:0:23906:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498983.091651:0:23906:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091656:0:23906:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498983.091672:0:23906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091679:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff98eabaddfc00/0x3a6cb1946bc19cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3a6cb1946bc19d02 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.091693:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498983.091695:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498983.091696:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498983.091703:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498983.091722:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885714560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498983.091886:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498983.091985:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498983.091992:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885714688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498983.092070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498983.092128:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885714816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498983.092265:0:26033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714176:0@lo:104: 00000100:00100000:1.0:1789498983.092276:0:26033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714304:0@lo:104: 00000100:00100000:1.0:1789498983.092296:0:26033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26033:1876424885714432:0@lo:104: 00010000:00010000:1.0:1789498983.092324:0:26033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498983.092381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498983.092415:0:23904:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789498983.092424:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714560 00000100:00100000:2.0:1789498983.092461:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714560 00010000:00010000:2.0:1789498983.092485:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 19 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498983.092574:0:23904:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789498983.092580:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714688 00000100:00100000:2.0:1789498983.092583:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714688 00010000:00010000:2.0:1789498983.092594:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 20 pid: 23912 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498983.092603:0:23904:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789498983.092607:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714816 00000100:00100000:2.0:1789498983.092609:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714816 00010000:00010000:2.0:1789498983.092616:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 21 pid: 23910 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498983.092625:0:23904:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789498983.092631:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498983.092636:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+21:3307:x1876424885714560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498983.092648:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498983.092653:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 21 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092663:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 21 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092677:0:23904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa4e00/0x3a6cb1946bc19e9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19e98 expref: 21 pid: 23911 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092690:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498983.092772:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+20:3307:x1876424885714560:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498983.092779:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498983.092801:0:23904:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789498983.092807:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498983.092812:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3307:x1876424885714688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498983.092821:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498983.092826:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 19 pid: 23912 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092834:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 19 pid: 23912 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092843:0:23904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc19d4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19d48 expref: 19 pid: 23912 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092850:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498983.092872:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+18:3307:x1876424885714688:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498983.092877:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498983.092887:0:23904:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789498983.092892:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498983.092897:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+17:3305:x1876424885714816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498983.092905:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498983.092909:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 17 pid: 23910 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092928:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 17 pid: 23910 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092939:0:23904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98ea88aa5e00/0x3a6cb1946bc19d02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3a6cb1946bc19cfb expref: 17 pid: 23910 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092961:0:23904:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092969:0:23904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092983:0:23904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092990:0:23904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.092997:0:23904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.093014:0:23904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.093020:0:23904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498983.093024:0:23904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.093032:0:23904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.093048:0:23904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498983.093057:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498983.093086:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3305:x1876424885714816:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498983.093114:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498983.093382:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8f836406-9642-48a3-887d-ecfcbfd0595e:3305:1876424885714816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498983.093497:0:23902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:2356:x1876424864743808:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 3883us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498983.093513:0:23902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00010000:00010000:0.0:1789498983.095338:0:26033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.095354:0:26033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498983.095373:0:26033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98eabad24000/0x3a6cb1946bc1a03c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498983.097226:0:23901:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1789498983.098832:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885714560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498983.098868:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885714688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498983.920951:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885714944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498983.921041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498983.921253:0:24603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885714944 00000100:00100000:3.0:1789498983.921262:0:24603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885714944 00000100:00100000:3.0:1789498983.921343:0:24603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498983.921352:0:24603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885714944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498983.921392:0:24603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789498983.921473:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498983.921799:0:24603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885714944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 447us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498983.921807:0:24603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498983.922059:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885714944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498983.979383:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498984.427334:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885715328:0@lo:400:kworker.0 00000100:00100000:1.0:1789498984.427442:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498984.427563:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885715456:0@lo:400:kworker.0 00000100:00100000:1.0:1789498984.427592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.427728:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885715072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.427764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.427796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885715584:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.427821:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.427890:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498984.427897:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885715200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.427921:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.427939:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabd541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885715712:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.427967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.428003:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715328 00000100:00100000:3.0:1789498984.428014:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715328 00000100:00100000:3.0:1789498984.428077:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715200 00000100:00100000:3.0:1789498984.428081:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715200 00000100:00100000:3.0:1789498984.428135:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498984.428145:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885715328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428205:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885715328:12345-0@lo:400:kworker.0 Request processed in 61us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.428213:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498984.428228:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498984.428234:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885715200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428284:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885715200:12345-0@lo:400:kworker.0 Request processed in 50us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.428291:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498984.428310:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715456 00000100:00100000:3.0:1789498984.428315:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715456 00000100:00100000:3.0:1789498984.428337:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715584 00000100:00100000:3.0:1789498984.428339:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715584 00000100:00100000:3.0:1789498984.428353:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715712 00000100:00100000:3.0:1789498984.428356:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715712 00000100:00100000:3.0:1789498984.428370:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498984.428376:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885715456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428422:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876424885715456:12345-0@lo:400:kworker.0 Request processed in 46us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.428427:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498984.428437:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498984.428443:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885715584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428470:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885715584:12345-0@lo:400:kworker.0 Request processed in 28us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.428475:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498984.428485:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498984.428491:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885715712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428517:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876424885715712:12345-0@lo:400:kworker.0 Request processed in 26us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.428523:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789498984.428554:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498984.428560:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498984.428591:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885715328:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428632:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885715200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428641:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876424885715712:0@lo:400:kworker.0 00000100:00100000:3.0:1789498984.428649:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885715584:0@lo:400:kworker.0 00000100:00100000:1.0:1789498984.428734:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715072 00000100:00100000:1.0:1789498984.428739:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715072 00000100:00100000:1.0:1789498984.428775:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789498984.428782:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3307:x1876424885715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498984.428821:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+16:3307:x1876424885715072:12345-0@lo:400:kworker.0 Request processed in 39us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498984.428828:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789498984.428870:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876424885715456:0@lo:400:kworker.0 00000100:00100000:1.0:1789498984.428892:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885715072:0@lo:400:kworker.0 00000100:00100000:1.0:1789498984.429193:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498984.429202:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885715840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498984.429232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789498984.429302:0:23914:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789498984.429307:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea89568000 from 10 10000000:01000000:0.0:1789498984.429310:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498984.429344:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498984.429356:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498984.429366:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498984.429382:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885715968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498984.429421:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498984.429453:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9076f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498984.429505:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715968 00000100:00100000:1.0:1789498984.429509:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715968 00000100:00100000:1.0:1789498984.429551:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789498984.429558:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+16:23914:x1876424885715968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498984.429567:0:23911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498984.429583:0:23911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e00600/0x3a6cb1946bc1a04a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1a043 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.429604:0:23911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e00600/0x3a6cb1946bc1a04a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1a043 expref: 17 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.429615:0:23911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e00600/0x3a6cb1946bc1a04a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1a043 expref: 17 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.429624:0:23911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00600, rc 0) 00000100:00100000:1.0:1789498984.429655:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+17:23914:x1876424885715968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498984.429661:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789498984.429734:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885715968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498984.429747:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a04a expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498984.429757:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1a04a expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498984.429808:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498984.429831:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498984.429862:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9076f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498984.429914:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716096 00000100:00100000:1.0:1789498984.429918:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716096 00000100:00100000:1.0:1789498984.429946:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789498984.429953:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:23914:x1876424885716096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498984.430227:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:23914:x1876424885716096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498984.430235:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789498984.430305:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885715840 00000100:00100000:2.0:1789498984.430310:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885715840 00000100:00100000:2.0:1789498984.430343:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498984.430351:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885715840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789498984.430382:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498984.430436:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876424885715840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498984.430443:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498984.430481:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876424885715840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498984.430837:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498984.430880:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498984.430922:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498984.430954:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9076f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498984.431013:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716224 00000100:00100000:1.0:1789498984.431018:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716224 00000100:00100000:1.0:1789498984.431085:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789498984.431114:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+17:23914:x1876424885716224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498984.431279:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+17:23914:x1876424885716224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498984.431292:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789498984.431358:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789498984.435583:0:26047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789498984.435767:0:23914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789498984.435793:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498984.435806:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a04a expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498984.435819:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabad24000/0x3a6cb1946bc1a043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a04a expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498984.435830:0:23914:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789498984.435833:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98ea89100000 from 10 10000000:01000000:2.0:1789498984.435836:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789498984.435890:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498984.435898:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498984.435909:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498984.435938:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.436020:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498984.439765:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498984.444833:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716352 00000100:00100000:3.0:1789498984.444851:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716352 00000100:00100000:3.0:1789498984.444920:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789498984.444932:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea914f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+17:23914:x1876424885716352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498984.444951:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498984.444973:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabadde200/0x3a6cb1946bc1a058 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1a051 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.445011:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadde200/0x3a6cb1946bc1a058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1a051 expref: 18 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.445022:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabadde200/0x3a6cb1946bc1a058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1a051 expref: 18 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.445031:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde200, rc 0) 00000100:00100000:3.0:1789498984.445156:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea914f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885716352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (9135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.445163:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789498984.461567:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498984.461606:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a058 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498984.461622:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1a058 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498984.461715:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.461792:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498984.461822:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716480 00000100:00100000:2.0:1789498984.461838:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498984.461847:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716480 00000100:00100000:0.0:1789498984.461905:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789498984.461914:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885716480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498984.462232:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885716480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498984.462241:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789498984.462261:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.462292:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.462327:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498984.462356:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9f69a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498984.462417:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716608 00000100:00100000:1.0:1789498984.462422:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716608 00000100:00100000:1.0:1789498984.462461:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789498984.462468:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885716608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498984.462630:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885716608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498984.462648:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789498984.466350:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eabaaadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789498984.486011:0:26048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789498984.487689:0:23914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789498984.487725:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498984.487740:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a058 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.487789:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98ea88aa5e00/0x3a6cb1946bc1a051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a058 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498984.487802:0:23914:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498984.487806:0:23914:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e9852f1000 from 10 10000000:01000000:3.0:1789498984.487809:0:23914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498984.487851:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.487860:0:23914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.487872:0:23914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498984.487900:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498984.487973:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.488022:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801240 going to sleep for 11 seconds 00000100:00100000:1.0:1789498984.488441:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716736 00000100:00100000:1.0:1789498984.488450:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716736 00000100:00100000:1.0:1789498984.488498:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789498984.488506:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+18:23914:x1876424885716736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498984.488521:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498984.488535:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc1a066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3a6cb1946bc1a05f expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.488560:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc1a066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3a6cb1946bc1a05f expref: 19 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.488584:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eac1e00000/0x3a6cb1946bc1a066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3a6cb1946bc1a05f expref: 19 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.488593:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00000, rc 0) 00000100:00100000:1.0:1789498984.488641:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885716736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498984.488648:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789498984.488969:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498984.488985:0:23914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a066 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.488996:0:23914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3a6cb1946bc1a066 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498984.489079:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498984.489141:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.489180:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801240 going to sleep for 11 seconds 00000100:00100000:2.0:1789498984.489303:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716864 00000100:00100000:2.0:1789498984.489313:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716864 00000100:00100000:2.0:1789498984.489343:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789498984.489351:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885716864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.489676:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885716864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498984.489684:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789498984.491772:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498984.491870:0:23914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498984.491951:0:23914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498984.491985:0:23914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea88801240 going to sleep for 11 seconds 00000100:00100000:2.0:1789498984.492249:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885716992 00000100:00100000:2.0:1789498984.492260:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885716992 00000100:00100000:2.0:1789498984.492316:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789498984.492326:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885716992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.492552:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f836406-9642-48a3-887d-ecfcbfd0595e+19:23914:x1876424885716992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498984.492559:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789498984.492774:0:23914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8f836406-9642-48a3-887d-ecfcbfd0595e:23914:1876424885716992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789498984.498914:0:26049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789498984.513303:0:23914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789498984.513346:0:23914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498984.513360:0:23914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a066 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498984.513375:0:23914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff98eabaddf400/0x3a6cb1946bc1a05f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3a6cb1946bc1a066 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498984.655397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498984.655535:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864743936 00000100:00100000:3.0:1789498984.655547:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864743936 00000100:00100000:3.0:1789498984.655610:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:3.0:1789498984.655623:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+11:17716:x1876424864743936:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498984.655643:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498984.655663:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc1a06d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a6f9 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.655696:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc1a06d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f9 expref: 12 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.655707:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabadde600/0x3a6cb1946bc1a06d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f9 expref: 12 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.655717:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabadde600, rc 0) 00000100:00100000:3.0:1789498984.655796:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17716:x1876424864743936:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 176us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.655803:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:3.0:1789498984.662209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498984.662347:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744064 00000100:00100000:2.0:1789498984.662357:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744064 00000100:00100000:2.0:1789498984.662419:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:2.0:1789498984.662429:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17716:x1876424864744064:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.662713:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17716:x1876424864744064:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 284us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498984.662721:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:0.0:1789498984.669015:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498984.669180:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744192 00000100:00100000:2.0:1789498984.669191:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744192 00000100:00100000:2.0:1789498984.669248:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:2.0:1789498984.669257:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17716:x1876424864744192:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.669501:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17716:x1876424864744192:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 245us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498984.669517:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:1.0:1789498984.679021:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498984.679127:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744320 00000100:00100000:3.0:1789498984.679138:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744320 00000100:00100000:3.0:1789498984.679196:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:3.0:1789498984.679221:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+12:17716:x1876424864744320:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498984.679241:0:23910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498984.679259:0:23910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc1a074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a700 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.679290:0:23910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc1a074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a700 expref: 13 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.679301:0:23910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98eabaddfe00/0x3a6cb1946bc1a074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a700 expref: 13 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498984.679310:0:23910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabaddfe00, rc 0) 00000100:00100000:3.0:1789498984.679368:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17716:x1876424864744320:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 149us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.679375:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:0.0:1789498984.683512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498984.683603:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744448 00000100:00100000:3.0:1789498984.683615:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744448 00000100:00100000:3.0:1789498984.683678:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:3.0:1789498984.683689:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17716:x1876424864744448:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498984.684060:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17716:x1876424864744448:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 371us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498984.684069:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:0.0:1789498984.688330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498984.688446:0:23912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744576 00000100:00100000:2.0:1789498984.688459:0:23912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744576 00000100:00100000:2.0:1789498984.688525:0:23912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:2.0:1789498984.688536:0:23912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17716:x1876424864744576:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498984.688798:0:23912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:17716:x1876424864744576:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 264us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498984.688807:0:23912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00010000:00010000:2.0:1789498985.005164:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498985.087137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.091251:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744704 00000100:00100000:3.0:1789498985.091287:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744704 00000100:00100000:3.0:1789498985.091494:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498985.091509:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:18324:x1876424864744704:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498985.091563:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498985.091593:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc1a07b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a707 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.091690:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.091708:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.091723:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.091743:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.091750:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.091757:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.092701:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1a090 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.092725:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1a090 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.092737:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1a090 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498985.092778:0:23919:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789498985.092790:0:23919:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498985.092843:0:23919:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1a090 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.092859:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.092867:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.092875:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789498985.093410:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789498985.094588:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabadde000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498985.094604:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094623:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094647:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:3.0:1789498985.094651:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498985.094658:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094667:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabadde000/0x3a6cb1946bc1a082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094693:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094703:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094736:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094742:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498985.094745:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094751:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094760:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98ea9108cc00) 00010000:00010000:3.0:1789498985.094762:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498985.094766:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.094772:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a089 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.096690:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddfc00/0x3a6cb1946bc1a07b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a707 expref: 8 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.096735:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91e00/0x3a6cb1946bc1a090 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a707 expref: 7 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.096746:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98ea9108ce00) 00010000:00010000:3.0:1789498985.096749:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498985.096753:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91e00, rc 0) 00000100:00100000:3.0:1789498985.099205:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:18324:x1876424864744704:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 7683us (12061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498985.099249:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498985.114727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.115259:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864744960 00000100:00100000:1.0:1789498985.115278:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864744960 00000100:00100000:1.0:1789498985.115365:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1789498985.115374:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:18324:x1876424864744960:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498985.115403:0:23917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498985.115424:0:23917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1a097 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a70e expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115522:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115537:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115549:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115563:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115588:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115595:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115985:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1a0ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.115995:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1a0ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116003:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1a0ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498985.116015:0:23917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789498985.116293:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116302:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116309:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116315:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498985.116320:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116328:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116350:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98ea9108ce00) 00010000:00010000:1.0:1789498985.116353:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498985.116359:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116366:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a09e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116379:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116385:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116390:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116407:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498985.116410:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116415:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116423:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98ea83c9c900) 00010000:00010000:1.0:1789498985.116425:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498985.116428:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116433:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a0a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116961:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00800/0x3a6cb1946bc1a097 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a70e expref: 10 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116979:0:23917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01a00/0x3a6cb1946bc1a0ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a70e expref: 9 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.116986:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea83c9cd00) 00010000:00010000:1.0:1789498985.116988:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498985.116991:0:23917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01a00, rc 0) 00000100:00100000:1.0:1789498985.117082:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18324:x1876424864744960:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1708us (2372us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789498985.117125:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498985.121891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.122220:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745088 00000100:00100000:2.0:1789498985.122234:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745088 00000100:00100000:2.0:1789498985.122308:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1789498985.122318:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18324:x1876424864745088:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789498985.122481:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18324:x1876424864745088:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 Request processed in 162us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498985.122489:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1789498985.176533:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498985.176750:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745216 00000100:00100000:0.0:1789498985.176767:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745216 00000100:00100000:0.0:1789498985.176948:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:0.0:1789498985.176964:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18330:x1876424864745216:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1789498985.177003:0:24829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498985.177201:0:24829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25000/0x3a6cb1946bc1a0ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a715 expref: -99 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.177951:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178165:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178182:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178207:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178214:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178221:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178753:0:24829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178765:0:24829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178773:0:24829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178781:0:24829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad25e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498985.178786:0:24829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178891:0:24829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178909:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:0.0:1789498985.178913:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498985.178920:0:24829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178927:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25e00/0x3a6cb1946bc1a0c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178944:0:24829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178950:0:24829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.178957:0:24829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179235:0:24829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad24400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498985.179239:0:24829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179247:0:24829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179264:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98ea895a3d00) 00010000:00010000:0.0:1789498985.179267:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498985.179271:0:24829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179290:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad24400/0x3a6cb1946bc1a0c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179359:0:24829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25000/0x3a6cb1946bc1a0ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a715 expref: 10 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179373:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:0.0:1789498985.179376:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498985.179380:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad25000/0x3a6cb1946bc1a0ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a715 expref: 10 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.179400:0:24829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad25000, rc 0) 00000100:00100000:0.0:1789498985.179510:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18330:x1876424864745216:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 2548us (2991us total) trans 0 rc 301/301 00000100:00100000:0.0:1789498985.179521:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:0.0:1789498985.189160:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.189719:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745344 00000100:00100000:1.0:1789498985.189735:0:23926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745344 00000100:00100000:1.0:1789498985.190563:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1789498985.192654:0:23926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18330:x1876424864745344:12345-192.168.201.20@tcp:700:lfs.0 00000100:00100000:1.0:1789498985.193206:0:23926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18330:x1876424864745344:12345-192.168.201.20@tcp:700:lfs.0 Request processed in 593us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498985.193220:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498985.197008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.197175:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745600 00000100:00100000:3.0:1789498985.197190:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745600 00000100:00100000:3.0:1789498985.197290:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1789498985.197303:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18330:x1876424864745600:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:3.0:1789498985.197410:0:23918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498985.197452:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabaddee00/0x3a6cb1946bc19ffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a690 expref: 9 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.197479:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:3.0:1789498985.197484:0:23918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498985.198663:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.198694:0:23918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 5 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.198705:0:23918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.198764:0:23918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 5 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.198785:0:23918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 5 pid: 24829 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498985.198902:0:23918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23918:1876424885717120:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498985.199127:0:23918:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea84447780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498985.204450:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.205294:0:23918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23918:1876424885717120:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498985.205339:0:23918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498985.205454:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745728 00000100:00100000:0.0:1789498985.205468:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745728 00010000:00010000:0.0:1789498985.205624:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 6 pid: 24829 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498985.205679:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:0.0:1789498985.205692:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2356:x1876424864745728:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498985.205714:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498985.205723:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 6 pid: 24829 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.205762:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 6 pid: 24829 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.206131:0:23904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01600/0x3a6cb1946bc1a035 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a6f2 expref: 6 pid: 24829 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.206160:0:23904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:0.0:1789498985.206166:0:23904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.206179:0:23904:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.206187:0:23904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.206227:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498985.206321:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2356:x1876424864745728:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 630us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498985.206332:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00010000:00010000:2.0:1789498985.206420:0:23918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.206429:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.206483:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.206497:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.206507:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789498985.210772:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789498985.211446:0:23918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498985.211474:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.211488:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.211498:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.211504:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498985.211510:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.211520:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.211542:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea9108c200) 00010000:00010000:2.0:1789498985.211545:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498985.211553:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.211652:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90c00/0x3a6cb1946bc1a0cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498985.211685:0:23918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdc9afa0 reply state 00000000db76857a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498985.211696:0:23918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498985.212123:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:18330:x1876424864745600:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 14815us (15123us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789498985.212135:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00010000:00010000:0.0:1789498985.216665:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.216691:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.216700:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.216730:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498985.216736:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.216745:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.216766:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98ea8382b400) 00010000:00010000:0.0:1789498985.216769:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498985.216774:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.216781:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a0d6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498985.315438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.315601:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745856 00000100:00100000:2.0:1789498985.315616:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745856 00000100:00100000:2.0:1789498985.315751:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498985.315763:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:18338:x1876424864745856:12345-192.168.201.20@tcp:101:lctl.0 00010000:00010000:2.0:1789498985.315883:0:23917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498985.315993:0:23917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a0dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a71c expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.316115:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc1a0e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.316133:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc1a0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.316150:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc1a0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498985.316206:0:23917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498985.316211:0:23917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498985.316304:0:23917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc1a0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.316331:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a0dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a71c expref: 11 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.316355:0:23917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4c00/0x3a6cb1946bc1a0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a71c expref: 10 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.316363:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:2.0:1789498985.316366:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498985.316371:0:23917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4c00, rc 0) 00000100:00100000:2.0:1789498985.316459:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:18338:x1876424864745856:12345-192.168.201.20@tcp:101:lctl.0 Request processed in 698us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498985.316468:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000040:00080000:0.0:1789498985.327341:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498985.335454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.335604:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864745984 00000100:00100000:3.0:1789498985.335618:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864745984 00000100:00100000:3.0:1789498985.335701:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:3.0:1789498985.335716:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:18339:x1876424864745984:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498985.335747:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498985.335775:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a0eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a723 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.336142:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc1a0f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.336162:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc1a0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.336177:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc1a0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498985.336234:0:23919:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789498985.336238:0:23919:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498985.336282:0:23919:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc1a0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.336311:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a0eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a723 expref: 7 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.336359:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90600/0x3a6cb1946bc1a0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a723 expref: 6 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.336369:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:3.0:1789498985.336373:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498985.336378:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90600, rc 0) 00000100:00100000:3.0:1789498985.336470:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:18339:x1876424864745984:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 758us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498985.336479:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:3.0:1789498985.338907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498985.339079:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864746112 00000100:00100000:0.0:1789498985.339124:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864746112 00000100:00100000:1.0:1789498985.339249:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498985.339353:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:18339:x1876424864746112:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498985.339384:0:24829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498985.339428:0:24829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a0f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a72a expref: -99 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339537:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339557:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339571:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339590:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339597:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339603:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339750:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a10e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339759:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a10e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339766:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a10e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498985.339826:0:24829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498985.339831:0:24829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498985.339855:0:24829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a10e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339884:0:24829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339891:0:24829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339899:0:24829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.339906:0:24829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498985.339912:0:24829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340063:0:24829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340080:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:1.0:1789498985.340084:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498985.340123:0:24829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340131:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340147:0:24829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340155:0:24829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340160:0:24829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340173:0:24829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498985.340177:0:24829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340183:0:24829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340191:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98ea83c9c900) 00010000:00010000:1.0:1789498985.340193:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498985.340196:0:24829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340202:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a107 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340241:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a0f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a72a expref: 8 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340344:0:24829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a10e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a72a expref: 7 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.340355:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498985.340358:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498985.340360:0:24829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00e00, rc 0) 00000100:00100000:1.0:1789498985.340467:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+7:18339:x1876424864746112:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1120us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498985.340476:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1789498985.343905:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.344044:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864746368 00000100:00100000:2.0:1789498985.344056:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864746368 00000100:00100000:2.0:1789498985.344506:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1789498985.344519:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+7:18339:x1876424864746368:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498985.344544:0:23918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498985.344564:0:23918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a731 expref: -99 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498985.344670:0:23918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789498985.344810:0:23918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a115 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a731 expref: 9 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.344837:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:2.0:1789498985.344840:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498985.344846:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a731 expref: 9 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.344860:0:23918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:2.0:1789498985.344937:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+8:18339:x1876424864746368:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 423us (1043us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1789498985.344943:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1789498985.348291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.348348:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864746624 00000100:00100000:1.0:1789498985.348358:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864746624 00000100:00100000:1.0:1789498985.348513:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:1.0:1789498985.348525:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+8:18339:x1876424864746624:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:1.0:1789498985.348590:0:23917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498985.348616:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a10e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a72a expref: 8 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.348632:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498985.348643:0:23917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498985.348665:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.350075:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.350102:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498985.350363:0:23917:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034941ed2 reply state 00000000f0238011 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498985.350374:0:23917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789498985.350382:0:23917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789498985.350494:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+9:18339:x1876424864746624:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 1970us (2207us total) trans 12884901892 rc 0/0 00010000:00010000:3.0:1789498985.351850:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.351866:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.351873:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.351888:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498985.351894:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.351903:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.351923:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c900) 00010000:00010000:3.0:1789498985.351928:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789498985.351950:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.351957:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a123 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498985.352487:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1789498985.355016:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.355687:0:23920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864746880 00000100:00100000:1.0:1789498985.355698:0:23920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864746880 00000100:00100000:1.0:1789498985.355759:0:23920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:1.0:1789498985.355785:0:23920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+8:18339:x1876424864746880:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498985.356430:0:23920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+9:18339:x1876424864746880:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 645us (1422us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789498985.356439:0:23920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:0.0:1789498985.357957:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498985.357988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.358063:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747136 00000100:00100000:3.0:1789498985.358073:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747136 00000100:00100000:0.0:1789498985.358107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498985.358137:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.358202:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747392 00000100:00100000:3.0:1789498985.358206:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747392 00000100:00100000:1.0:1789498985.358252:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747008 00000100:00100000:1.0:1789498985.358256:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747008 00000100:00080000:2.0:1789498985.358352:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498985.358356:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498985.358615:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747264 00000100:00100000:3.0:1789498985.358619:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747264 00000100:00100000:3.0:1789498985.358637:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1789498985.358647:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2356:x1876424864747136:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498985.358727:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2356:x1876424864747136:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498985.358734:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1789498985.358754:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498985.358760:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2356:x1876424864747392:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498985.358785:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2356:x1876424864747392:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498985.358790:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498985.358801:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498985.358806:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2355:x1876424864747264:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498985.358826:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2355:x1876424864747264:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498985.358831:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00080000:2.0:1789498985.359014:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498985.360794:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1789498985.360809:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2355:x1876424864747008:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1789498985.361562:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2355:x1876424864747008:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 74us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498985.361571:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498985.362523:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.362790:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747648 00000100:00100000:3.0:1789498985.362799:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747648 00000100:00100000:3.0:1789498985.362841:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1789498985.362850:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+9:18339:x1876424864747648:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1789498985.362872:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498985.362901:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a12a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a738 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.362968:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.362978:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.362987:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.362996:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363000:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363004:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498985.363128:0:23919:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789498985.363230:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363235:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363252:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363256:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498985.363259:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363264:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363282:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:3.0:1789498985.363285:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498985.363289:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363294:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363303:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363307:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363311:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363313:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498985.363315:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363325:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363329:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98ea9108cc00) 00010000:00010000:3.0:1789498985.363330:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498985.363332:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363336:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363365:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a12a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a738 expref: 11 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363372:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:3.0:1789498985.363373:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498985.363375:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a12a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a738 expref: 11 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498985.363380:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90800, rc 0) 00000100:00100000:3.0:1789498985.363436:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+10:18339:x1876424864747648:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 587us (916us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1789498985.363443:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1789498985.368924:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.369025:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747776 00000100:00100000:1.0:1789498985.369033:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747776 00000100:00100000:1.0:1789498985.369081:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1789498985.369118:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+10:18339:x1876424864747776:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498985.369151:0:23917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498985.369174:0:23917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a146 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a73f expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.369263:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.369274:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.369285:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498985.369323:0:23917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789498985.369326:0:23917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498985.369341:0:23917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.369361:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a146 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 12 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.369373:0:23917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 11 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.369379:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498985.369381:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498985.369383:0:23917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01800, rc 0) 00000100:00100000:1.0:1789498985.369448:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+11:18339:x1876424864747776:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 358us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498985.369454:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1789498985.388585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498985.388695:0:23921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864747904 00000100:00100000:3.0:1789498985.388706:0:23921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864747904 00000100:00100000:3.0:1789498985.388764:0:23921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498985.388774:0:23921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+11:18339:x1876424864747904:12345-192.168.201.20@tcp:37:lfs.0 00000100:00100000:3.0:1789498985.399251:0:23921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+11:18339:x1876424864747904:12345-192.168.201.20@tcp:37:lfs.0 Request processed in 10467us (10663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498985.399265:0:23921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:0.0:1789498985.421459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.421736:0:23920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864748160 00000100:00100000:1.0:1789498985.421748:0:23920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864748160 00000100:00100000:1.0:1789498985.421814:0:23920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1789498985.421825:0:23920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac0b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+11:18339:x1876424864748160:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498985.422806:0:23920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac0b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+12:18339:x1876424864748160:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 979us (1354us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789498985.422816:0:23920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1789498985.478952:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.479054:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864748288 00000100:00100000:2.0:1789498985.479066:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864748288 00000100:00100000:2.0:1789498985.479175:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1789498985.479185:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:18345:x1876424864748288:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498985.479208:0:23918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498985.479229:0:23918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a746 expref: -99 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479297:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479312:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479340:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479356:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479362:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479366:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479491:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a169 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479500:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a169 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479506:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a169 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498985.479539:0:23918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789498985.479542:0:23918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498985.479582:0:23918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a169 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479593:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479600:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479616:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479621:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498985.479625:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479633:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479644:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:2.0:1789498985.479648:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498985.479652:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479658:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a15b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479671:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479677:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479684:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479689:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498985.479691:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479707:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479716:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98ea8382bd00) 00010000:00010000:2.0:1789498985.479718:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498985.479721:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479727:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479758:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a746 expref: 12 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479770:0:23918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4400/0x3a6cb1946bc1a169 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a746 expref: 11 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.479778:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:2.0:1789498985.479780:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789498985.479783:0:23918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4400, rc 0) 00000100:00100000:2.0:1789498985.479841:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+11:18345:x1876424864748288:12345-192.168.201.20@tcp:101:bash.0 Request processed in 657us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498985.479849:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1789498985.483232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.483372:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864748544 00000100:00100000:2.0:1789498985.483381:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864748544 00000100:00100000:2.0:1789498985.483483:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:2.0:1789498985.483494:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+11:18345:x1876424864748544:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498985.483532:0:24829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498985.483556:0:24829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a170 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a74d expref: -99 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.483703:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.483718:0:24829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 11 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.483726:0:24829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.483765:0:24829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 11 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.483781:0:24829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 11 pid: 23917 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498985.483795:0:24829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24829:1876424885717248:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498985.484189:0:24829:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498985.488331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.488353:0:24829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24829:1876424885717248:192.168.201.20@tcp:104: 00000100:00100000:0.0:1789498985.488432:0:23902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864748672 00000100:00100000:0.0:1789498985.488440:0:23902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864748672 00010000:00010000:0.0:1789498985.488478:0:23902:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 12 pid: 23917 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498985.488515:0:23902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1789498985.488525:0:23902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+12:2355:x1876424864748672:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498985.488542:0:23902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498985.488549:0:23902:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 12 pid: 23917 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.488562:0:23902:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 12 pid: 23917 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.488589:0:23902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01800/0x3a6cb1946bc1a14d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a73f expref: 12 pid: 23917 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.488606:0:23902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:0.0:1789498985.488612:0:23902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.488623:0:23902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.488630:0:23902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.488645:0:23902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498985.488693:0:23902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d553bf33-c495-43cb-9bd6-6262e7a28bcb+11:2355:x1876424864748672:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 170us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498985.488700:0:23902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:1.0:1789498985.488756:0:24829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.488766:0:24829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.488772:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.488795:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.488805:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.488812:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.490828:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.490848:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.490858:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498985.490869:0:24829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789498985.490958:0:24829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.490967:0:24829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.490992:0:24829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.490999:0:24829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498985.491004:0:24829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.491013:0:24829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.491026:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:1.0:1789498985.491029:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498985.491032:0:24829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.491039:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a177 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498985.491055:0:24829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000321edecd reply state 0000000081453840 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498985.491065:0:24829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789498985.491142:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a170 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 14 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.491157:0:24829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 13 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.491163:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498985.491169:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789498985.491171:0:24829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01e00, rc 0) 00000100:00100000:1.0:1789498985.491236:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+14:18345:x1876424864748544:12345-192.168.201.20@tcp:101:bash.0 Request processed in 7744us (8012us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789498985.491246:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00010000:00010000:0.0:1789498985.497549:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.497636:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.497646:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.497653:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498985.497661:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.497672:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.497755:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98ea83c9c400) 00010000:00010000:0.0:1789498985.497759:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498985.497765:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498985.497772:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a17e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498985.501252:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.501639:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864748800 00000100:00100000:2.0:1789498985.501651:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864748800 00000100:00100000:2.0:1789498985.503636:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1789498985.503648:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+13:18345:x1876424864748800:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1789498985.503676:0:23918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498985.503699:0:23918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a193 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a754 expref: -99 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503788:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503801:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503812:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498985.503859:0:23918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789498985.503863:0:23918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789498985.503896:0:23918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503908:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503933:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a193 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 15 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503954:0:23918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 14 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.503972:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498985.503975:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498985.503978:0:23918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4a00, rc 0) 00000100:00100000:2.0:1789498985.504084:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+14:18345:x1876424864748800:12345-192.168.201.20@tcp:101:bash.0 Request processed in 438us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498985.504107:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1789498985.507650:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.508218:0:23921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864749056 00000100:00100000:1.0:1789498985.508231:0:23921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864749056 00000100:00100000:1.0:1789498985.508322:0:23921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1789498985.508333:0:23921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+14:18345:x1876424864749056:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:1.0:1789498985.508928:0:23921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+15:18345:x1876424864749056:12345-192.168.201.20@tcp:35:bash.0 Request processed in 595us (1360us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789498985.508938:0:23921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1789498985.620813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.620941:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864749312 00000100:00100000:1.0:1789498985.620952:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864749312 00000100:00100000:1.0:1789498985.621028:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1789498985.621037:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+15:18355:x1876424864749312:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1789498985.621067:0:23917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498985.621113:0:23917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a75b expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498985.621223:0:23917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789498985.621363:0:23917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a75b expref: 17 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.621381:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98ea8382b700) 00010000:00010000:1.0:1789498985.621395:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498985.621402:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a75b expref: 17 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.621435:0:23917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e01c00, rc 0) 00000100:00100000:1.0:1789498985.621512:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+16:18355:x1876424864749312:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 475us (709us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1789498985.621519:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1789498985.630797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.632906:0:23920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864749568 00000100:00100000:2.0:1789498985.632924:0:23920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864749568 00000100:00100000:2.0:1789498985.633055:0:23920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1789498985.633067:0:23920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+16:18355:x1876424864749568:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1789498985.633963:0:23920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+17:18355:x1876424864749568:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 884us (3162us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1789498985.633973:0:23920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1789498985.682685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.682917:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864749824 00000100:00100000:2.0:1789498985.682930:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864749824 00000100:00100000:2.0:1789498985.683003:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1789498985.683014:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+17:18358:x1876424864749824:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1789498985.683041:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498985.683075:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1af lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a762 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.683216:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.683228:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.683237:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498985.683246:0:23919:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498985.683397:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1af lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a762 expref: 20 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.683414:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a762 expref: 19 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.683433:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498985.683435:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498985.683439:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5000, rc 0) 00000100:00100000:2.0:1789498985.683504:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+19:18358:x1876424864749824:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 491us (831us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789498985.683512:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:0.0:1789498985.690889:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498985.690997:0:23903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864749952 00000100:00100000:2.0:1789498985.691008:0:23903:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864749952 00000100:00100000:2.0:1789498985.691087:0:23903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498985.691126:0:23903:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+19:2356:x1876424864749952:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498985.691144:0:23903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498985.691172:0:23903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a762 expref: 19 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498985.691191:0:23903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498985.691197:0:23903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498985.691260:0:23903:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+18:2356:x1876424864749952:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498985.691268:0:23903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1789498985.691478:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.692519:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864750080 00000100:00100000:1.0:1789498985.692529:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864750080 00000100:00100000:1.0:1789498985.692673:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1789498985.692684:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+18:18358:x1876424864750080:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:1.0:1789498985.692746:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692762:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692773:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692802:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692809:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692816:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692822:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498985.692827:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692848:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692860:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498985.692863:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498985.692868:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498985.692885:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01c00/0x3a6cb1946bc1a1c4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498985.692964:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+18:18358:x1876424864750080:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 272us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498985.692973:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1789498985.694747:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498985.694801:0:23921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864750336 00000100:00100000:1.0:1789498985.694810:0:23921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864750336 00000100:00100000:1.0:1789498985.695013:0:23921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1789498985.695024:0:23921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+18:18358:x1876424864750336:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1789498985.695301:0:23921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+19:18358:x1876424864750336:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 279us (559us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1789498985.695308:0:23921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1789498986.010256:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.010598:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864750592 00000100:00100000:2.0:1789498986.010611:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864750592 00000100:00100000:2.0:1789498986.010681:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1789498986.010692:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+19:18389:x1876424864750592:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:2.0:1789498986.010718:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498986.010743:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a769 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.010904:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.010920:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.010934:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498986.010947:0:23919:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498986.011211:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1cb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a769 expref: 22 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.011232:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a769 expref: 21 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.011241:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.011244:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498986.011249:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:2.0:1789498986.011309:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+21:18389:x1876424864750592:12345-192.168.201.20@tcp:101:cat.0 Request processed in 618us (1061us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789498986.011317:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:0.0:1789498986.015829:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498986.015917:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.015931:0:23920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864750848 00000100:00100000:2.0:1789498986.015947:0:23920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864750848 00000100:00100000:3.0:1789498986.016029:0:26035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864750976 00000100:00100000:3.0:1789498986.016039:0:26035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864750976 00000100:00100000:2.0:1789498986.016046:0:23920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:2.0:1789498986.016130:0:23920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+22:18389:x1876424864750848:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:3.0:1789498986.016175:0:26035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1789498986.016190:0:26035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+22:2358:x1876424864750976:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498986.016211:0:26035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498986.016246:0:26035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a769 expref: 22 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.016277:0:26035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:3.0:1789498986.016284:0:26035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498986.016365:0:26035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+22:2358:x1876424864750976:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 179us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.016375:0:26035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1789498986.016545:0:23920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+21:18389:x1876424864750848:12345-192.168.201.20@tcp:35:cat.0 Request processed in 420us (733us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789498986.016568:0:23920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00010000:00010000:2.0:1789498986.027696:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498986.114585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.114715:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864751232 00000100:00100000:2.0:1789498986.114971:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864751232 00000100:00100000:2.0:1789498986.115157:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:2.0:1789498986.115170:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+21:18395:x1876424864751232:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1789498986.115202:0:24829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498986.115225:0:24829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1e0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a770 expref: -99 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115340:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115356:0:24829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 22 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115365:0:24829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 22 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115388:0:24829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115424:0:24829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 22 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115439:0:24829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 22 pid: 23918 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.115475:0:24829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24829:1876424885717376:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498986.115599:0:24829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 22 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.115609:0:24829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 22 pid: 24829 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.115619:0:24829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24829:1876424885717504:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498986.115646:0:24829:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fdc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498986.122010:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.122137:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.123407:0:24829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24829:1876424885717376:192.168.201.20@tcp:104: 00000100:00100000:2.0:1789498986.123430:0:24829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24829:1876424885717504:192.168.201.20@tcp:104: 00010000:00010000:2.0:1789498986.123478:0:24829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.125163:0:23904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864751360 00000100:00100000:0.0:1789498986.125163:0:23903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864751488 00000100:00100000:1.0:1789498986.125182:0:23904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864751360 00000100:00100000:0.0:1789498986.125232:0:23903:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864751488 00010000:00010000:1.0:1789498986.125255:0:23904:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 23 pid: 23918 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.125391:0:23903:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 24 pid: 24829 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.125502:0:23904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1789498986.125515:0:23903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1789498986.125521:0:23904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:2355:x1876424864751360:12345-192.168.201.20@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789498986.125521:0:23903:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:2355:x1876424864751488:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498986.125542:0:23904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498986.125542:0:23903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498986.125551:0:23904:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 24 pid: 23918 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.125551:0:23903:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 24 pid: 24829 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.125565:0:23903:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 24 pid: 24829 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.125648:0:23904:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 24 pid: 23918 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.125673:0:23903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01e00/0x3a6cb1946bc1a185 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a74d expref: 24 pid: 24829 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.125676:0:23904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a19a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a754 expref: 24 pid: 23918 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.125696:0:23904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498986.125701:0:23904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.125711:0:23904:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.125719:0:23904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.125726:0:23903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:0.0:1789498986.125729:0:23903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498986.125788:0:23904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498986.125811:0:23904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+22:2355:x1876424864751360:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 292us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498986.125811:0:23903:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+22:2355:x1876424864751488:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 288us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498986.125819:0:23903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00010000:00010000:2.0:1789498986.125999:0:24829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.126006:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498986.126033:0:24829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498986.126288:0:24829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a1e0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a770 expref: 23 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.126318:0:24829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5400/0x3a6cb1946bc1a1e7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a770 expref: 22 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.126334:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.126337:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498986.126340:0:24829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5400, rc 0) 00000100:00100000:2.0:1789498986.126383:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+22:18395:x1876424864751232:12345-192.168.201.20@tcp:101:dd.0 Request processed in 11209us (11805us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789498986.126392:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1789498986.127720:0:23904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1789498986.128217:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.128339:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864751744 00000100:00100000:2.0:1789498986.128350:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864751744 00000100:00100000:2.0:1789498986.128412:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1789498986.128425:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+21:18395:x1876424864751744:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1789498986.128813:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.128835:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.128845:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498986.128906:0:23919:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789498986.128926:0:23919:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5077d34 reply state 000000009af7de24 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.128933:0:23919:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498986.129266:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18395:x1876424864751744:12345-192.168.201.20@tcp:36:dd.0 Request processed in 841us (1048us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789498986.129274:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000020:00080000:2.0:1789498986.129286:0:23919:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789498986.130982:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.131003:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.131010:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.131014:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498986.131018:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.131033:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.131051:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:3.0:1789498986.131054:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498986.131061:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.131067:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a1f5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498986.131239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498986.131430:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864751872 00000100:00100000:1.0:1789498986.131444:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864751872 00000100:00100000:1.0:1789498986.131547:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:1.0:1789498986.131558:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+23:18395:x1876424864751872:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1789498986.131606:0:23917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498986.131626:0:23917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a1fc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a777 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.131687:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a1fc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a777 expref: 24 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.131698:0:23917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a1fc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a777 expref: 24 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.131715:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498986.131716:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498986.131719:0:23917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eac1e00400, rc 0) 00000100:00100000:1.0:1789498986.131777:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18395:x1876424864751872:12345-192.168.201.20@tcp:101:dd.0 Request processed in 221us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498986.131784:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:0.0:1789498986.139711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.140260:0:23902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864752128 00000100:00100000:2.0:1789498986.140276:0:23902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864752128 00000100:00100000:2.0:1789498986.140385:0:23902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1789498986.140398:0:23902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18395:x1876424864752128:12345-192.168.201.20@tcp:103:dd.0 00010000:00010000:2.0:1789498986.140423:0:23902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498986.140454:0:23902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00400/0x3a6cb1946bc1a1fc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a777 expref: 24 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.140474:0:23902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.140479:0:23902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498986.140546:0:23902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+23:18395:x1876424864752128:12345-192.168.201.20@tcp:103:dd.0 Request processed in 152us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.140554:0:23902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1789498986.152482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.152595:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864752256 00000100:00100000:2.0:1789498986.152611:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864752256 00000100:00100000:2.0:1789498986.152755:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1789498986.152770:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+23:18395:x1876424864752256:12345-192.168.201.20@tcp:58:dd.0 00010000:00010000:2.0:1789498986.152925:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.152948:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.152962:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498986.156415:0:23918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498986.156600:0:23918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1789498986.156691:0:23918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1789498986.156820:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+23:18395:x1876424864752256:12345-192.168.201.20@tcp:58:dd.0 Request processed in 4049us (6639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.156832:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:0.0:1789498986.161731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.161866:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864752384 00000100:00100000:2.0:1789498986.161882:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864752384 00000100:00100000:2.0:1789498986.161970:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1789498986.161984:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+23:18395:x1876424864752384:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1789498986.162022:0:24829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498986.162054:0:24829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a77e expref: -99 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.162246:0:24829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.164020:0:24829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 24 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.164056:0:24829:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.164084:0:24829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 24 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.164116:0:24829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.164119:0:24829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498986.164122:0:24829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 24 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.164149:0:24829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa5600, rc 0) 00000100:00100000:2.0:1789498986.164267:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18395:x1876424864752384:12345-192.168.201.20@tcp:101:dd.0 Request processed in 2283us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.164278:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000040:00080000:0.0:1789498986.348346:0:23951:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789498986.348356:0:23951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498986.348422:0:23951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789498986.348429:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789498986.348597:0:23951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23951:1876424885717632:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789498986.348757:0:23951:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea9076f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498986.352498:0:23951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23951:1876424885717632:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789498986.354174:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498986.355928:0:23928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864752512 00000100:00100000:0.0:1789498986.355952:0:23928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864752512 00000100:00100000:0.0:1789498986.356026:0:23928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1789498986.356038:0:23928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864752512:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789498986.356188:0:23928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864752512:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 Request processed in 151us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498986.356196:0:23928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1789498986.362442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.371558:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864752640 00000100:00100000:3.0:1789498986.371577:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864752640 00000100:00100000:3.0:1789498986.371692:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498986.371704:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864752640:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789498986.371739:0:23919:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789498986.371952:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864752640:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 250us (9521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.371960:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1789498986.387629:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498986.387851:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864752768 00000100:00100000:1.0:1789498986.387863:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864752768 00000100:00100000:1.0:1789498986.387933:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:1.0:1789498986.387943:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864752768:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789498986.388018:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388034:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388064:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388529:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388540:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388549:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388576:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388583:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388601:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498986.388659:0:23917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789498986.388664:0:23917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789498986.388678:0:23917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388688:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388695:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388711:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388718:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498986.388722:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388730:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388742:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea83c9cd00) 00010000:00010000:1.0:1789498986.388745:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498986.388750:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388756:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00e00/0x3a6cb1946bc1a211 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388770:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388775:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388781:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388785:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498986.388788:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388801:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388808:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff98ea83c9c300) 00010000:00010000:1.0:1789498986.388810:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498986.388813:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388818:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e01400/0x3a6cb1946bc1a218 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388834:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388840:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388846:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388851:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e00a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789498986.388854:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388858:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388865:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:1.0:1789498986.388868:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498986.388871:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.388889:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eac1e00a00/0x3a6cb1946bc1a21f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.388970:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864752768:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 1026us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498986.388985:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:1.0:1789498986.397500:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.398977:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864753024 00000100:00100000:3.0:1789498986.398990:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864753024 00000100:00100000:3.0:1789498986.399063:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:3.0:1789498986.399073:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+24:18396:x1876424864753024:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.399123:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498986.399146:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a226 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a785 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399263:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399278:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399291:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498986.399303:0:23919:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789498986.399439:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399722:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399730:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399756:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498986.399761:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399770:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399783:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:3.0:1789498986.399786:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789498986.399791:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399798:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a22d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399844:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a226 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a785 expref: 26 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399855:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98ea83c9cd00) 00010000:00010000:3.0:1789498986.399857:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789498986.399873:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a226 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a785 expref: 26 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.399883:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91400, rc 0) 00000100:00100000:3.0:1789498986.399956:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+25:18396:x1876424864753024:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 884us (2465us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1789498986.399964:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:0.0:1789498986.403225:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.403513:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864753152 00000100:00100000:2.0:1789498986.403525:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864753152 00000100:00100000:2.0:1789498986.403599:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:2.0:1789498986.403743:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+25:18396:x1876424864753152:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789498986.403777:0:24829:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789498986.403879:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+25:18396:x1876424864753152:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 271us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.403887:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:0.0:1789498986.407753:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.407985:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864753408 00000100:00100000:2.0:1789498986.407997:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864753408 00000100:00100000:2.0:1789498986.408063:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:2.0:1789498986.408074:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+25:18396:x1876424864753408:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498986.408131:0:23918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498986.408155:0:23918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a23b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a78c expref: -99 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789498986.409486:0:23918:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x23:0x0], count =31 00000004:00080000:2.0:1789498986.409497:0:23918:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1789498986.409558:0:23918:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:2.0:1789498986.410056:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a242 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.410082:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a242 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.410121:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a242 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.410190:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a23b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a78c expref: 28 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.410209:0:23918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a242 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a78c expref: 27 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.410218:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea8382bd00) 00010000:00010000:2.0:1789498986.410221:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498986.410225:0:23918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4a00, rc 0) 00000100:00100000:2.0:1789498986.410354:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+27:18396:x1876424864753408:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 2281us (2609us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1789498986.410363:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1789498986.425830:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.426976:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864753664 00000100:00100000:3.0:1789498986.427005:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864753664 00000100:00100000:3.0:1789498986.427076:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:3.0:1789498986.427087:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+27:18396:x1876424864753664:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.427197:0:23917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498986.427242:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a242 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a78c expref: 27 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427270:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea8382bd00) 00010000:00010000:3.0:1789498986.427281:0:23917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498986.427315:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427331:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427342:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427356:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427361:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427366:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427470:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427477:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427490:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427496:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498986.427500:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427508:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427517:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98ea83c9c700) 00010000:00010000:3.0:1789498986.427520:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498986.427524:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427530:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a250 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427547:0:23917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427553:0:23917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427559:0:23917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427563:0:23917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498986.427566:0:23917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427582:0:23917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427590:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd7371196 (ffff98ea9108cc00) 00010000:00010000:3.0:1789498986.427592:0:23917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498986.427595:0:23917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.427601:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a257 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd7371196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498986.427690:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+26:18396:x1876424864753664:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 605us (1869us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498986.427698:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1789498986.431016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.431169:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864753792 00000100:00100000:3.0:1789498986.431190:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864753792 00000100:00100000:3.0:1789498986.431273:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:3.0:1789498986.431284:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabd542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+26:18396:x1876424864753792:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.431314:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498986.431338:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a25e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a793 expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.431387:0:23919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90000/0x3a6cb1946bc1a265 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.431402:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90000/0x3a6cb1946bc1a265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.431415:0:23919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90000/0x3a6cb1946bc1a265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.431545:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a25e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a793 expref: 28 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.431564:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90000/0x3a6cb1946bc1a265 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a793 expref: 27 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.431573:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498986.431576:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789498986.431580:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90000, rc 0) 00000100:00100000:3.0:1789498986.431646:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabd542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+27:18396:x1876424864753792:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 365us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.431653:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:3.0:1789498986.436355:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.436686:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864754048 00000100:00100000:2.0:1789498986.436696:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864754048 00000100:00100000:2.0:1789498986.436754:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:2.0:1789498986.436764:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+27:18396:x1876424864754048:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789498986.436850:0:24829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.436871:0:24829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.436901:0:24829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498986.437310:0:24829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1789498986.437320:0:24829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 886201228643ns, next at 887201227042ns, rc = 0 00000004:00010000:2.0:1789498986.437422:0:24829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e648a3a9 reply state 00000000669b2e96 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.437433:0:24829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789498986.437537:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+29:18396:x1876424864754048:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 773us (1190us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1789498986.437544:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:1.0:1789498986.473128:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:0.0:1789498986.473600:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.473614:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.473622:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.473628:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789498986.473633:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.473642:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.473659:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:0.0:1789498986.473661:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789498986.473683:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.473700:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a26c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498986.474070:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864754176 00000100:00100000:3.0:1789498986.474854:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864754176 00000100:00100000:2.0:1789498986.475181:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:2.0:1789498986.475194:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+28:18396:x1876424864754176:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498986.475235:0:23919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498986.475266:0:23919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a79a expref: -99 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.475344:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 29 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.475358:0:23919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 29 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.475391:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:2.0:1789498986.475394:0:23919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498986.475412:0:23919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98ea88aa4a00, rc 0) 00000100:00100000:2.0:1789498986.475504:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+29:18396:x1876424864754176:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 313us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.475512:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:1.0:1789498986.489950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.490696:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864754304 00000100:00100000:3.0:1789498986.490707:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864754304 00000100:00100000:3.0:1789498986.490795:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1789498986.490806:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2356:x1876424864754304:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789498986.492770:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2356:x1876424864754304:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 1953us (2826us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789498986.492784:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1789498986.506589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498986.506854:0:23921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864754560 00000100:00100000:1.0:1789498986.506934:0:23921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864754560 00000100:00100000:1.0:1789498986.507018:0:23921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498986.507030:0:23921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+29:18396:x1876424864754560:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789498986.507532:0:23921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+30:18396:x1876424864754560:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 491us (941us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1789498986.507541:0:23921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1789498986.521589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.521783:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864754816 00000100:00100000:2.0:1789498986.521791:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864754816 00000100:00100000:2.0:1789498986.521840:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:2.0:1789498986.521850:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+30:18396:x1876424864754816:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789498986.521966:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabaaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+30:18396:x1876424864754816:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.521972:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:0.0:1789498986.526824:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.526914:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864754944 00000100:00100000:3.0:1789498986.526924:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864754944 00000100:00100000:3.0:1789498986.527000:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:3.0:1789498986.527012:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+30:18396:x1876424864754944:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.527038:0:23918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498986.527062:0:23918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a27a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a7a1 expref: -99 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.527209:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a281 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.527222:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a281 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.527234:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a281 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498986.527298:0:23918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789498986.527320:0:23918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a281 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.527346:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91a00/0x3a6cb1946bc1a27a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a1 expref: 32 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.527366:0:23918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a281 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a1 expref: 31 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.527410:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498986.527413:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789498986.527417:0:23918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad90800, rc 0) 00000100:00100000:3.0:1789498986.528976:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+31:18396:x1876424864754944:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 1957us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.528987:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1789498986.540209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.540508:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864755072 00000100:00100000:3.0:1789498986.540519:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864755072 00000100:00100000:3.0:1789498986.540575:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1789498986.540614:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2356:x1876424864755072:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.540633:0:25097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498986.540655:0:25097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4457bb8be5a9a7a8 expref: -99 pid: 25097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789498986.540684:0:25097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9966a, blocks: 0x1 00010000:00010000:3.0:1789498986.540704:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1789498986.540709:0:25097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498986.540719:0:25097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 7 pid: 25097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.540738:0:25097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 7 pid: 25097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.540750:0:25097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98eabad91a00, rc 0) 00000100:00100000:3.0:1789498986.540812:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2356:x1876424864755072:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 202us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.540820:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1789498986.547187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.547291:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864755328 00000100:00100000:2.0:1789498986.547302:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864755328 00000100:00100000:2.0:1789498986.547379:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:2.0:1789498986.547391:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+31:18396:x1876424864755328:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789498986.547507:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+31:18396:x1876424864755328:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.547515:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:0.0:1789498986.552567:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.552754:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864755456 00000100:00100000:2.0:1789498986.552764:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864755456 00000100:00100000:2.0:1789498986.552822:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:2.0:1789498986.552833:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+31:18396:x1876424864755456:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789498986.627423:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000001:00080000:0.0:1789498986.627450:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000004:00080000:0.0:1789498986.627467:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789498986.627596:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+14:18396:x1876424864755456:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 74758us (75031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.627623:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:3.0:1789498986.627787:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498986.627802:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885717760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789498986.627848:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498986.628133:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885717760 00000100:00100000:0.0:1789498986.628140:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885717760 00000100:00100000:0.0:1789498986.628185:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789498986.628191:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885717760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789498986.628319:0:24599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789498986.628322:0:24599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789498986.628324:0:24599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789498986.628325:0:24599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1789498986 -> 1789498986 00002000:00010000:0.0:1789498986.628327:0:24599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789498986.628356:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876424885717760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (507us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789498986.628360:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789498986.628409:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98eab9c3b800/2, rc 0, transno 12884901891 00000100:00100000:0.0:1789498986.628416:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885717760:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789498986.628472:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498986.631137:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.631270:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864755584 00000100:00100000:3.0:1789498986.631279:0:25097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864755584 00000100:00100000:3.0:1789498986.631326:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1789498986.631337:0:25097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2355:x1876424864755584:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789498986.631600:0:25097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2355:x1876424864755584:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 264us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.631618:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1789498986.633800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.633991:0:23917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864755840 00000100:00100000:3.0:1789498986.634002:0:23917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864755840 00000100:00100000:3.0:1789498986.634148:0:23917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1789498986.634160:0:23917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+14:18396:x1876424864755840:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.634212:0:23917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498986.634239:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a281 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a1 expref: 14 pid: 23918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.634270:0:23917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498986.634275:0:23917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498986.634304:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.634318:0:23917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.634328:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498986.634548:0:23917:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003963a458 reply state 000000005d8382a9 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498986.634558:0:23917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498986.634651:0:23917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+15:18396:x1876424864755840:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 493us (861us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789498986.634658:0:23917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00010000:00010000:3.0:1789498986.636691:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.636725:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.636734:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.636738:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789498986.636742:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.636749:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.636763:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:3.0:1789498986.636765:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498986.636769:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.636773:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad91400/0x3a6cb1946bc1a28f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498986.638496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.638591:0:24599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864755968 00000100:00100000:2.0:1789498986.638600:0:24599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864755968 00000100:00100000:2.0:1789498986.638649:0:24599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:2.0:1789498986.638659:0:24599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2356:x1876424864755968:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789498986.638838:0:24599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789498986.638841:0:24599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1789498985 00002000:00010000:2.0:1789498986.638842:0:24599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1789498985 00002000:00010000:2.0:1789498986.638844:0:24599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1789498986 -> 1789498985 00002000:00010000:2.0:1789498986.638846:0:24599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789498986.638953:0:24599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+8:2356:x1876424864755968:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 295us (463us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789498986.638958:0:24599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1789498986.641290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498986.641397:0:24602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864756096 00000100:00100000:1.0:1789498986.641407:0:24602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864756096 00000100:00100000:1.0:1789498986.641463:0:24602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1789498986.641473:0:24602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+8:2355:x1876424864756096:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789498986.641518:0:24602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641551:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498986.641556:0:24602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498986.641562:0:24602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641577:0:24602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641611:0:24602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641621:0:24602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641630:0:24602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641638:0:24602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498986.641642:0:24602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641652:0:24602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641667:0:24602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.641681:0:24602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.641822:0:24602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+8:2355:x1876424864756096:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 349us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498986.641830:0:24602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:0.0:1789498986.644350:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.644443:0:23918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864756352 00000100:00100000:3.0:1789498986.644455:0:23918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864756352 00000100:00100000:3.0:1789498986.644527:0:23918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:3.0:1789498986.644539:0:23918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+14:18396:x1876424864756352:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789498986.644636:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.644657:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.644685:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.645010:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.645023:0:23918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 15 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.645032:0:23918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.645069:0:23918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 15 pid: 23919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.645085:0:23918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 15 pid: 23919 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498986.645128:0:23918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23918:1876424885717888:192.168.201.20@tcp:104: 00000100:00100000:3.0:1789498986.645218:0:23918:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87385d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789498986.648023:0:23918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9c3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23918:1876424885717888:192.168.201.20@tcp:104: 00010000:00010000:3.0:1789498986.648048:0:23918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498986.648979:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.649064:0:23903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864756480 00000100:00100000:2.0:1789498986.649073:0:23903:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864756480 00010000:00010000:2.0:1789498986.649147:0:23903:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 16 pid: 23919 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.649177:0:23903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1789498986.649185:0:23903:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+16:2356:x1876424864756480:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498986.649197:0:23903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498986.649202:0:23903:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 16 pid: 23919 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.649211:0:23903:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 16 pid: 23919 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.649248:0:23903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a273 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a79a expref: 16 pid: 23919 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.649266:0:23903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:2.0:1789498986.649271:0:23903:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.649280:0:23903:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.649287:0:23903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.649474:0:23918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.649474:0:23903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498986.649481:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.649535:0:23903:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+15:2356:x1876424864756480:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 350us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498986.649542:0:23903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000001:00080000:3.0:1789498986.649699:0:23918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1789498986.650655:0:23918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1789498986.650714:0:23918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1789498986.650792:0:23918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23918:1876424885718016:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789498986.650944:0:23918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498986.651017:0:23918:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eaa62a2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498986.651292:0:23922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885718016 00000100:00100000:0.0:1789498986.651300:0:23922:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885718016 00000100:00100000:0.0:1789498986.651384:0:23922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498986.651394:0:23922:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23918:x1876424885718016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789498986.651502:0:23922:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23918:x1876424885718016:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498986.651509:0:23922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498986.651583:0:23918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23918:1876424885718016:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789498986.652319:0:23918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1789498986.652403:0:23918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23918:1876424885718144:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789498986.652450:0:23918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498986.652481:0:23918:0:(client.c:2716:ptlrpc_set_wait()) set ffff98eab9d2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498986.652571:0:23923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885718144 00000100:00100000:1.0:1789498986.652576:0:23923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885718144 00000100:00100000:1.0:1789498986.652609:0:23923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498986.652614:0:23923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23918:x1876424885718144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789498986.652782:0:23923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:23918:x1876424885718144:12345-0@lo:1000:mdt00_001.0 Request processed in 162us (327us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789498986.652790:0:23923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498986.652820:0:23918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23918:1876424885718144:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789498986.652863:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652874:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652881:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652887:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498986.652892:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652901:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652916:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:2.0:1789498986.652920:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498986.652925:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652932:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90200/0x3a6cb1946bc1a2a4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652973:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652979:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652985:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.652996:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498986.652999:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.653005:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.653014:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.653016:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498986.653023:0:23918:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 18 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.653032:0:23918:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 18 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.653039:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 18 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.653059:0:23918:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5600/0x3a6cb1946bc1a20a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a77e expref: 18 pid: 24829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.653067:0:23918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fa1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23918:1876424885718272:192.168.201.20@tcp:105: 00000100:00100000:2.0:1789498986.653147:0:23918:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea82fd4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789498986.655790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498986.655805:0:23918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fa1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23918:1876424885718272:192.168.201.20@tcp:105: 00010000:00010000:2.0:1789498986.655834:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655868:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa5000/0x3a6cb1946bc1a203 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.655882:0:23921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864756608 00000100:00100000:1.0:1789498986.655889:0:23921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864756608 00010000:00010000:2.0:1789498986.655899:0:23918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655912:0:23918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655924:0:23918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655943:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655950:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.655950:0:23921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:2.0:1789498986.655956:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.655959:0:23921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e9847e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+19:18395:x1876424864756608:12345-192.168.201.20@tcp:49:dd.0 00010000:00010000:2.0:1789498986.655963:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498986.655966:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655973:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.655984:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.655987:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498986.655991:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656003:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4e00/0x3a6cb1946bc1a2ab lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656014:0:23918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656019:0:23918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656024:0:23918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656028:0:23918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad90800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789498986.656031:0:23918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656036:0:23918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656043:0:23918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98ea83c9c100) 00010000:00010000:2.0:1789498986.656045:0:23918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789498986.656048:0:23918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.656052:0:23918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98eabad90800/0x3a6cb1946bc1a29d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.656197:0:23921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e9847e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+19:18395:x1876424864756608:12345-192.168.201.20@tcp:49:dd.0 Request processed in 238us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498986.656204:0:23921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1789498986.656291:0:23918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+18:18396:x1876424864756352:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 11755us (11951us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789498986.656300:0:23918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000020:00080000:2.0:1789498986.656309:0:23918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789498986.656501:0:23951:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789498986.656506:0:23951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498986.656532:0:23951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789498986.656538:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789498986.658694:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.658791:0:23920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864756864 00000100:00100000:3.0:1789498986.658804:0:23920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864756864 00000100:00100000:3.0:1789498986.658912:0:23920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1789498986.658922:0:23920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+18:18396:x1876424864756864:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789498986.659795:0:23920:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789498986.660026:0:23920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1789498986.660073:0:23920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.660231:0:23920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.660247:0:23920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.661413:0:23920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.661428:0:23920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.661435:0:23920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.661507:0:23920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789498986.661629:0:23920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3440e60a-8ca4-432e-ae5e-d35d9331aa73+20:18396:x1876424864756864:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 2702us (2938us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1789498986.661639:0:23920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000020:00080000:2.0:1789498986.661646:0:23920:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789498986.661704:0:23905:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498986.661711:0:23905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.661719:0:23905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498986.661724:0:23905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.661734:0:23905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.661753:0:23905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98ea9108c500) 00010000:00010000:0.0:1789498986.661756:0:23905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789498986.661761:0:23905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.661768:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98ea88aa4a00/0x3a6cb1946bc1a2b2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 23920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498986.661800:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498986.661803:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498986.661806:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498986.791127:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498986.791176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498986.791219:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498986.791296:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864756992 00000100:00100000:1.0:1789498986.791307:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864756992 00000100:00100000:1.0:1789498986.791355:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757120 00000100:00100000:1.0:1789498986.791358:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757120 00000100:00100000:1.0:1789498986.791381:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757248 00000100:00100000:1.0:1789498986.791398:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757248 00000100:00100000:1.0:1789498986.791427:0:24606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1789498986.791440:0:24606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:2357:x1876424864756992:12345-192.168.201.20@tcp:4:dd.0 00010000:00010000:1.0:1789498986.791480:0:24606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.791505:0:24606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 10 pid: 25097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.791513:0:24606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498986.791517:0:24606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498986.791521:0:24606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.791557:0:24606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 10 pid: 25097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.791572:0:24606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 10 pid: 25097 timeout: 986 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498986.791590:0:24606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:24606:1876424885718400:192.168.201.20@tcp:104: 00000100:00100000:1.0:1789498986.791703:0:24606:0:(client.c:2716:ptlrpc_set_wait()) set ffff98ea87fcf900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498986.793751:0:24606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eac1cfd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:24606:1876424885718400:192.168.201.20@tcp:104: 00010000:00010000:1.0:1789498986.793776:0:24606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498986.797203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498986.797298:0:26035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757376 00000100:00100000:3.0:1789498986.797309:0:26035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757376 00010000:00010000:3.0:1789498986.797355:0:26035:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 11 pid: 25097 timeout: 986 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498986.797413:0:26035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1789498986.797424:0:26035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+11:2355:x1876424864757376:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498986.797439:0:26035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498986.797465:0:26035:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 11 pid: 25097 timeout: 986 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.797481:0:26035:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 11 pid: 25097 timeout: 986 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.797506:0:26035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a288 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x4457bb8be5a9a7a8 expref: 11 pid: 25097 timeout: 986 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.797550:0:26035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498986.797555:0:26035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498986.797564:0:26035:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.797575:0:26035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498986.797599:0:26035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498986.797654:0:26035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:2355:x1876424864757376:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 231us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498986.797662:0:26035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00010000:00010000:1.0:1789498986.799306:0:24606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498986.799326:0:24606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789498986.908392:0:24606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1789498986.908404:0:24606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1789498985 -> 1789498986 00002000:00010000:2.0:1789498986.908408:0:24606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1789498986.908424:0:24606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908461:0:24606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908470:0:24606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908477:0:24606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01600 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498986.908482:0:24606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908493:0:24606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908519:0:24606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908528:0:24606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000468b76da/0x3a6cb1946bc1a2b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498986.908636:0:24606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+11:2357:x1876424864756992:12345-192.168.201.20@tcp:4:dd.0 Request processed in 117193us (117514us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1789498986.908652:0:24606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1789498986.908694:0:24606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1789498986.908706:0:24606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:2358:x1876424864757120:12345-192.168.201.20@tcp:4:dd.0 00002000:00010000:2.0:1789498986.908750:0:24606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 1048576, mtime: 0x6aa9966a, atime: 0x6aa99669, ctime: 0x0, blocks: 0x803 00010000:00010000:2.0:1789498986.908763:0:24606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908776:0:24606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1789498986.908781:0:24606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498986.908788:0:24606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498986.908802:0:24606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498986.909448:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901891 is committed 00000001:00080000:3.0:1789498986.909464:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00000001:00080000:3.0:1789498986.909471:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00010000:00010000:2.0:1789498987.052324:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789498987.055778:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00002000:00010000:2.0:1789498987.056454:0:24606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1789498987.056460:0:24606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1789498987.056475:0:24606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056488:0:24606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056498:0:24606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056505:0:24606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa4e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498987.056511:0:24606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056544:0:24606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056568:0:24606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056576:0:24606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ad20e90/0x3a6cb1946bc1a2c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498987.056735:0:24606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2358:x1876424864757120:12345-192.168.201.20@tcp:4:dd.0 Request processed in 148024us (265549us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789498987.056747:0:24606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1789498987.056782:0:24606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1789498987.056809:0:24606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864757248:12345-192.168.201.20@tcp:4:dd.0 00002000:00010000:2.0:1789498987.056873:0:24606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 2097152, mtime: 0x6aa9966a, atime: 0x6aa99669, ctime: 0x0, blocks: 0x1007 00010000:00010000:2.0:1789498987.056880:0:24606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056892:0:24606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1789498987.056896:0:24606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498987.056903:0:24606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.056916:0:24606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789498987.059081:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789498987.121650:0:24606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789498987.121661:0:24606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789498987.121677:0:24606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498987.121692:0:24606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498987.121701:0:24606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498987.121708:0:24606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98ea88aa5000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:0.0:1789498987.121714:0:24606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498987.121724:0:24606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498987.121747:0:24606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498987.121772:0:24606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5bdf49/0x3a6cb1946bc1a2c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498987.121897:0:24606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+7:2357:x1876424864757248:12345-192.168.201.20@tcp:4:dd.0 Request processed in 65101us (330671us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789498987.121913:0:24606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000001:00080000:2.0:1789498987.122127:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00000100:00100000:0.0:1789498987.130557:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498987.130833:0:24607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757504 00000100:00100000:3.0:1789498987.130851:0:24607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757504 00000100:00100000:0.0:1789498987.131544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1789498987.131572:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757632 00000100:00100000:0.0:1789498987.131576:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757632 00000100:00100000:3.0:1789498987.131684:0:24607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1789498987.131695:0:24607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+6:2355:x1876424864757504:12345-192.168.201.20@tcp:4:dd.0 00002000:00010000:3.0:1789498987.131753:0:24607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6aa9966a, atime: 0x6aa99669, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1789498987.131761:0:24607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.131776:0:24607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1789498987.131780:0:24607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498987.131802:0:24607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.131815:0:24607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498987.137524:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1789498987.137574:0:24605:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789498987.137585:0:24605:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789498987.137684:0:24606:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789498987.137694:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757760 00000100:00100000:0.0:1789498987.137705:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757760 00000100:00100000:0.0:1789498987.151265:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498987.151775:0:24606:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789498987.151790:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864757888 00000100:00100000:3.0:1789498987.151801:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864757888 00000100:00100000:0.0:1789498987.153014:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1789498987.153116:0:24606:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789498987.153129:0:24606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758016 00000100:00100000:3.0:1789498987.153136:0:24606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758016 00000100:00100000:3.0:1789498987.155752:0:26054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498987.155779:0:26054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+12:2356:x1876424864757632:12345-192.168.201.20@tcp:4:dd.0 00010000:00010000:3.0:1789498987.155834:0:26054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.155868:0:26054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498987.155874:0:26054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498987.155881:0:26054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.155899:0:26054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498987.242022:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00002000:00010000:1.0:1789498987.248874:0:24607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:1.0:1789498987.248885:0:24607:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1789498986 00002000:00010000:1.0:1789498987.248888:0:24607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1789498987.248905:0:24607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.248919:0:24607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249047:0:24607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249055:0:24607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91a00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498987.249061:0:24607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249072:0:24607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249425:0:24607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249436:0:24607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a20cb8e/0x3a6cb1946bc1a2ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498987.249551:0:24607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+12:2355:x1876424864757504:12345-192.168.201.20@tcp:4:dd.0 Request processed in 117849us (119000us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789498987.249563:0:24607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:1.0:1789498987.249609:0:24607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1789498987.249622:0:24607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eac1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+11:2356:x1876424864757760:12345-192.168.201.20@tcp:4:dd.0 00010000:00010000:1.0:1789498987.249658:0:24607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249671:0:24607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789498987.249677:0:24607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498987.249683:0:24607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.249696:0:24607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498987.287705:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00002000:00010000:3.0:1789498987.290588:0:26054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1789498987.290600:0:26054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1789498987.290635:0:26054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290650:0:26054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290660:0:26054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290668:0:26054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91400 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:3.0:1789498987.290673:0:26054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290681:0:26054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290703:0:26054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290710:0:26054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000115df209/0x3a6cb1946bc1a2d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498987.290818:0:26054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eaba120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+11:2356:x1876424864757632:12345-192.168.201.20@tcp:4:dd.0 Request processed in 135045us (159271us total) trans 12884901898 rc 0/0 00000100:00100000:3.0:1789498987.290830:0:26054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1789498987.290883:0:26054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1789498987.290896:0:26054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:2356:x1876424864757888:12345-192.168.201.20@tcp:4:dd.0 00010000:00010000:3.0:1789498987.290951:0:26054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290965:0:26054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498987.290970:0:26054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498987.290977:0:26054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498987.290991:0:26054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498987.396494:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00002000:00010000:1.0:1789498987.397801:0:24607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:1.0:1789498987.397825:0:24607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.397866:0:24607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.397878:0:24607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.397886:0:24607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01c00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:1.0:1789498987.397892:0:24607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.397903:0:24607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.400483:0:24607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.400505:0:24607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c9ebe3/0x3a6cb1946bc1a2dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498987.400608:0:24607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eac1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+10:2356:x1876424864757760:12345-192.168.201.20@tcp:4:dd.0 Request processed in 150985us (263095us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789498987.400619:0:24607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1789498987.400657:0:24607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1789498987.400669:0:24607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:2355:x1876424864758016:12345-192.168.201.20@tcp:4:dd.0 00010000:00010000:1.0:1789498987.400709:0:24607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.400737:0:24607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498987.400741:0:24607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498987.400748:0:24607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498987.400761:0:24607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498987.462867:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00002000:00010000:2.0:1789498987.465537:0:26054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1789498987.465587:0:26054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1789498987.465608:0:26054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.465624:0:26054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.465634:0:26054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.465642:0:26054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eabad91000 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498987.465647:0:26054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.465657:0:26054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.465680:0:26054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.465688:0:26054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d57fbdf/0x3a6cb1946bc1a2e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498987.465964:0:26054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3440e60a-8ca4-432e-ae5e-d35d9331aa73+9:2356:x1876424864757888:12345-192.168.201.20@tcp:4:dd.0 Request processed in 175066us (314718us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789498987.465977:0:26054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000001:00080000:0.0:1789498987.543362:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00002000:00010000:2.0:1789498987.543915:0:24607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789498987.543938:0:24607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.543953:0:24607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.543963:0:24607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.543972:0:24607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98eac1e01e00 already unused, calling callback (ffffffffc14d38b0) 00010000:00010000:2.0:1789498987.543978:0:24607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.543989:0:24607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.544014:0:24607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498987.544022:0:24607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e408fb0/0x3a6cb1946bc1a2ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498987.544264:0:24607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2355:x1876424864758016:12345-192.168.201.20@tcp:4:dd.0 Request processed in 143578us (391238us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789498987.544295:0:24607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00010000:00010000:0.0:1789498988.077173:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498989.038601:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885718528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498989.038743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498989.038910:0:24604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885718528 00000100:00100000:2.0:1789498989.038924:0:24604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885718528 00000100:00100000:2.0:1789498989.039000:0:24604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498989.039011:0:24604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885718528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789498989.039061:0:24604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789498989.046920:0:24604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876424885718528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7900us (8166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498989.046938:0:24604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789498989.046989:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498989.047117:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876424885718528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498989.103763:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789498989.452400:0:26092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1789498989.547396:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885719040:0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.547480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498989.547551:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789498989.547557:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eaba8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885718656:0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.547588:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498989.547609:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885719168:0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.547656:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498989.547692:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885719040 00000100:00100000:1.0:1789498989.547699:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885719040 00000100:00100000:1.0:1789498989.547745:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885719168 00000100:00100000:1.0:1789498989.547748:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885719168 00000100:00100000:1.0:1789498989.547778:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498989.547786:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885719040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.547860:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876424885719040:12345-0@lo:400:kworker.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498989.547867:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789498989.547903:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498989.547909:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885719168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.547939:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876424885719168:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498989.547945:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498989.547964:0:23910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885718656 00000100:00100000:1.0:1789498989.547968:0:23910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885718656 00000100:00100000:1.0:1789498989.547992:0:23910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789498989.547998:0:23910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3307:x1876424885718656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.548026:0:23910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f836406-9642-48a3-887d-ecfcbfd0595e+19:3307:x1876424885718656:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498989.548032:0:23910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789498989.548061:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498989.548117:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eaba8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8f836406-9642-48a3-887d-ecfcbfd0595e:3307:1876424885718656:0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.548132:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876424885719168:0@lo:400:kworker.0 00000100:00100000:1.0:1789498989.548141:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876424885719040:0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548467:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885718784:0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548502:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498989.548534:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885719296:0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498989.548621:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498989.548627:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885718912:0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548648:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498989.548679:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885718784 00000100:00100000:0.0:1789498989.548683:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885718784 00000100:00100000:0.0:1789498989.548720:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885718912 00000100:00100000:0.0:1789498989.548725:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885718912 00000100:00100000:0.0:1789498989.548750:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789498989.548756:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885718784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548795:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885718784:12345-0@lo:400:kworker.0 Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498989.548814:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789498989.548833:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789498989.548839:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885718912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548867:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885718912:12345-0@lo:400:kworker.0 Request processed in 29us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498989.548873:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789498989.548914:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:0.0:1789498989.548920:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98eab9c3b800, transno 12884901891 00000004:00080000:0.0:1789498989.548931:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:0.0:1789498989.548947:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885718912:0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.548958:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885718784:0@lo:400:kworker.0 00000100:00080000:0.0:1789498989.549388:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789498989.549399:0:24829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885719296 00000100:00100000:0.0:1789498989.549404:0:24829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885719296 00000100:00100000:0.0:1789498989.549434:0:24829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789498989.549441:0:24829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885719296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498989.549481:0:24829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876424885719296:12345-0@lo:400:kworker.0 Request processed in 41us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498989.549487:0:24829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789498989.549513:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876424885719296:0@lo:400:kworker.0 00000100:00080000:0.0:1789498989.549536:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498989.558993:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498989.559017:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98eab9fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498989.559103:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498989.559158:0:24603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424885719424 00000100:00100000:0.0:1789498989.559167:0:24603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424885719424 00000100:00100000:0.0:1789498989.559212:0:24603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789498989.559222:0:24603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eabb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885719424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498989.559264:0:24603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789498989.559323:0:24603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eabb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424885719424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498989.559331:0:24603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789498989.559395:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98eab9fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876424885719424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789498990.124887:0:23905:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498990.485080:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485168:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485186:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1789498990.485290:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758528 00000100:00100000:2.0:1789498990.485312:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758528 00000100:00100000:2.0:1789498990.485366:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758784 00000100:00100000:2.0:1789498990.485369:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758784 00000100:00100000:2.0:1789498990.485382:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758400 00000100:00100000:2.0:1789498990.485392:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758400 00000100:00100000:2.0:1789498990.485408:0:24601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758912 00000100:00100000:2.0:1789498990.485410:0:24601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758912 00000100:00100000:2.0:1789498990.485428:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1789498990.485437:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864758528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498990.485620:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864758528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 183us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498990.485627:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1789498990.485645:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498990.485652:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864758784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498990.485676:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864758784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498990.485682:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1789498990.485692:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498990.485698:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864758400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498990.485719:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3440e60a-8ca4-432e-ae5e-d35d9331aa73+5:2357:x1876424864758400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 21us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498990.485726:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1789498990.485736:0:24601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1789498990.485742:0:24601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864758912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1789498990.485764:0:24601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d553bf33-c495-43cb-9bd6-6262e7a28bcb+5:2357:x1876424864758912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498990.485769:0:24601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00080000:2.0:1789498990.485882:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498990.485892:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498990.486045:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758272 00000100:00100000:3.0:1789498990.486050:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758272 00000100:00100000:3.0:1789498990.486112:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758656 00000100:00100000:3.0:1789498990.486116:0:23919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758656 00000100:00100000:3.0:1789498990.486139:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1789498990.486146:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98eab9fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+20:2357:x1876424864758272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498990.486180:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98eab9fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3440e60a-8ca4-432e-ae5e-d35d9331aa73+20:2357:x1876424864758272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498990.486186:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1789498990.486198:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498990.486204:0:23919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98ea864d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2357:x1876424864758656:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498990.486241:0:23919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98ea864d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d553bf33-c495-43cb-9bd6-6262e7a28bcb+6:2357:x1876424864758656:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498990.486247:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1789498990.486266:0:23911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424864758144 00000100:00100000:3.0:1789498990.486270:0:23911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424864758144 00000100:00100000:3.0:1789498990.486294:0:23911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:3.0:1789498990.486319:0:23911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98e985154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:2358:x1876424864758144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1789498990.486343:0:23911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98e985154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8e5cac-06a0-4f76-8cbd-8d2df5ce9715+13:2358:x1876424864758144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498990.486349:0:23911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00080000:2.0:1789498990.486943:0:23913:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789498990.764458:0:23951:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789498990.764471:0:23951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789498990.764536:0:23951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789498990.764545:0:23951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1789498991.149680:0:23906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9826 lines, 9826 kept, 0 dropped, 0 bad.